Nov 16 00:34:51 user nova-compute[75826]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75826) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 00:34:51 user nova-compute[75826]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75826) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 00:34:51 user nova-compute[75826]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75826) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 16 00:34:51 user nova-compute[75826]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 16 00:34:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:34:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:34:52 user nova-compute[75826]: INFO nova.virt.driver [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 16 00:34:52 user nova-compute[75826]: INFO nova.compute.provider_config [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] Acquiring lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] Acquired lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] Releasing lock "singleton_lock" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] Full set of CONF: {{(pid=75826) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ******************************************************************************** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] Configuration options gathered from: {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ================================================================================ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] allow_resize_to_same_host      = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] arq_binding_timeout            = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] backdoor_port                  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] backdoor_socket                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] block_device_allocate_retries  = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] block_device_allocate_retries_interval = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cert                           = self.pem {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute_monitors               = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] config_dir                     = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] config_drive_format            = iso9660 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] config_source                  = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] console_host                   = user {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] control_exchange               = nova {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cpu_allocation_ratio           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] daemon                         = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] debug                          = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] default_access_ip_network_name = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] default_availability_zone      = nova {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] default_ephemeral_format       = ext4 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] default_green_pool_size        = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] default_schedule_zone          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] disk_allocation_ratio          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] enable_new_services            = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] enabled_apis                   = ['osapi_compute'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] enabled_ssl_apis               = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] flat_injected                  = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] force_config_drive             = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] force_raw_images               = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] graceful_shutdown_timeout      = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] heal_instance_info_cache_interval = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] host                           = user {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] instance_build_timeout         = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] instance_delete_interval       = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] instance_format                = [instance: %(uuid)s]  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] instance_name_template         = instance-%08x {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] instance_usage_audit           = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] instance_usage_audit_period    = month {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] internal_service_availability_zone = internal {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] key                            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] live_migration_retry_count     = 30 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] log_config_append              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] log_dir                        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] log_file                       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] log_options                    = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] log_rotate_interval            = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] log_rotate_interval_type       = days {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] log_rotation_type              = none {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] long_rpc_timeout               = 1800 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] max_concurrent_builds          = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] max_concurrent_live_migrations = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] max_concurrent_snapshots       = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] max_local_block_devices        = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] max_logfile_count              = 30 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] max_logfile_size_mb            = 200 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] maximum_instance_delete_attempts = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] metadata_listen                = 0.0.0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] metadata_listen_port           = 8775 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] metadata_workers               = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] migrate_max_retries            = -1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] mkisofs_cmd                    = genisoimage {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] my_ip                          = 10.0.0.210 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] network_allocate_retries       = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] osapi_compute_listen_port      = 8774 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] osapi_compute_unique_server_name_scope =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] osapi_compute_workers          = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] password_length                = 12 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] periodic_enable                = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] periodic_fuzzy_delay           = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] pointer_model                  = ps2mouse {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] preallocate_images             = none {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] publish_errors                 = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] pybasedir                      = /opt/stack/nova {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ram_allocation_ratio           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] rate_limit_burst               = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] rate_limit_except_level        = CRITICAL {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] rate_limit_interval            = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] reboot_timeout                 = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] reclaim_instance_interval      = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] record                         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] reimage_timeout_per_gb         = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] report_interval                = 120 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] rescue_timeout                 = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] reserved_host_cpus             = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] reserved_host_disk_mb          = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] reserved_host_memory_mb        = 512 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] reserved_huge_pages            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] resize_confirm_window          = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] resize_fs_using_block_device   = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] resume_guests_state_on_host_boot = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] rpc_response_timeout           = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] run_external_periodic_tasks    = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] running_deleted_instance_action = reap {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] running_deleted_instance_poll_interval = 1800 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] running_deleted_instance_timeout = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] scheduler_instance_sync_interval = 120 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] service_down_time              = 720 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] servicegroup_driver            = db {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] shelved_offload_time           = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] shelved_poll_interval          = 3600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] shutdown_timeout               = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] source_is_ipv6                 = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ssl_only                       = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] state_path                     = /opt/stack/data/nova {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] sync_power_state_interval      = 600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] sync_power_state_pool_size     = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] syslog_log_facility            = LOG_USER {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] tempdir                        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] timeout_nbd                    = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] transport_url                  = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] update_resources_interval      = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] use_cow_images                 = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] use_eventlog                   = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] use_journal                    = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] use_json                       = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] use_rootwrap_daemon            = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] use_stderr                     = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] use_syslog                     = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vcpu_pin_set                   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plugging_is_fatal          = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plugging_timeout           = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] virt_mkfs                      = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] volume_usage_poll_interval     = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] watch_log_file                 = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] web                            = /usr/share/spice-html5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_concurrency.disable_process_locking = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.auth_strategy              = keystone {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.compute_link_prefix        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.dhcp_domain                = novalocal {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.enable_instance_password   = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.glance_link_prefix         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.instance_list_per_project_cells = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.list_records_by_skipping_down_cells = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.local_metadata_per_cell    = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.max_limit                  = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.metadata_cache_expiration  = 15 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.neutron_default_tenant_id  = default {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.use_forwarded_for          = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.use_neutron_default_nets   = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.vendordata_dynamic_targets = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.vendordata_jsonfile_path   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.backend                  = dogpile.cache.memcached {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.backend_argument         = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.config_prefix            = cache.oslo {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.dead_timeout             = 60.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.debug_cache_backend      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.enable_retry_client      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.enable_socket_keepalive  = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.enabled                  = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.expiration_time          = 600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.hashclient_retry_attempts = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.memcache_dead_retry      = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.memcache_password        =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.memcache_pool_maxsize    = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.memcache_sasl_enabled    = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.memcache_username        =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.proxies                  = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.retry_attempts           = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.retry_delay              = 0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.socket_keepalive_count   = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.socket_keepalive_idle    = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.socket_keepalive_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.tls_allowed_ciphers      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.tls_cafile               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.tls_certfile             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.tls_enabled              = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cache.tls_keyfile              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.auth_section            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.auth_type               = password {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.cafile                  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.certfile                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.collect_timing          = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.cross_az_attach         = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.debug                   = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.endpoint_template       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.http_retries            = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.insecure                = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.keyfile                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.os_region_name          = RegionOne {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.split_loggers           = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cinder.timeout                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute.cpu_dedicated_set      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute.cpu_shared_set         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute.image_type_exclude_list = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute.max_concurrent_disk_ops = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute.max_disk_devices_to_attach = -1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute.resource_provider_association_refresh = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute.shutdown_retry_interval = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] conductor.workers              = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] console.allowed_origins        = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] console.ssl_ciphers            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] console.ssl_minimum_version    = default {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] consoleauth.token_ttl          = 600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.cafile                  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.certfile                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.collect_timing          = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.connect_retries         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.connect_retry_delay     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.endpoint_override       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.insecure                = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.keyfile                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.max_version             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.min_version             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.region_name             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.service_name            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.service_type            = accelerator {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.split_loggers           = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.status_code_retries     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.status_code_retry_delay = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.timeout                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] cyborg.version                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.backend               = sqlalchemy {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.connection            = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.connection_debug      = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.connection_parameters =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.connection_recycle_time = 3600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.connection_trace      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.db_inc_retry_interval = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.db_max_retries        = 20 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.db_max_retry_interval = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.db_retry_interval     = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.max_overflow          = 50 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.max_pool_size         = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.max_retries           = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.mysql_wsrep_sync_wait = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.pool_timeout          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.retry_interval        = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.slave_connection      = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] database.sqlite_synchronous    = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.backend           = sqlalchemy {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.connection        = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.connection_debug  = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.connection_parameters =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.connection_recycle_time = 3600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.connection_trace  = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.db_inc_retry_interval = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.db_max_retries    = 20 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.db_max_retry_interval = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.db_retry_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.max_overflow      = 50 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.max_pool_size     = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.max_retries       = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.pool_timeout      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.retry_interval    = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.slave_connection  = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] api_database.sqlite_synchronous = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] devices.enabled_mdev_types     = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ephemeral_storage_encryption.enabled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.api_servers             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.cafile                  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.certfile                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.collect_timing          = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.connect_retries         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.connect_retry_delay     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.debug                   = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.default_trusted_certificate_ids = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.enable_certificate_validation = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.enable_rbd_download     = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.endpoint_override       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.insecure                = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.keyfile                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.max_version             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.min_version             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.num_retries             = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.rbd_ceph_conf           =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.rbd_connect_timeout     = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.rbd_pool                =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.rbd_user                =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.region_name             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.service_name            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.service_type            = image {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.split_loggers           = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.status_code_retries     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.status_code_retry_delay = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.timeout                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.verify_glance_signatures = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] glance.version                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] guestfs.debug                  = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.config_drive_cdrom      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.config_drive_inject_password = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.enable_instance_metrics_collection = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.enable_remotefx         = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.instances_path_share    =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.iscsi_initiator_list    = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.limit_cpu_features      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.power_state_check_timeframe = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.use_multipath_io        = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.volume_attach_retry_count = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.vswitch_name            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] mks.enabled                    = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] image_cache.manager_interval   = 2400 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] image_cache.precache_concurrency = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] image_cache.remove_unused_base_images = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] image_cache.subdirectory_name  = _base {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.api_max_retries         = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.api_retry_interval      = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.auth_section            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.auth_type               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.cafile                  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.certfile                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.collect_timing          = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.conductor_group         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.connect_retries         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.connect_retry_delay     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.endpoint_override       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.insecure                = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.keyfile                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.max_version             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.min_version             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.peer_list               = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.region_name             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.serial_console_state_timeout = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.service_name            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.service_type            = baremetal {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.split_loggers           = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.status_code_retries     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.status_code_retry_delay = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.timeout                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ironic.version                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] key_manager.fixed_key          = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.barbican_api_version  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.barbican_endpoint     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.barbican_endpoint_type = public {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.barbican_region_name  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.cafile                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.certfile              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.collect_timing        = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.insecure              = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.keyfile               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.number_of_retries     = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.retry_delay           = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.send_service_user_token = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.split_loggers         = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.timeout               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.verify_ssl            = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican.verify_ssl_path       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican_service_user.auth_section = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican_service_user.auth_type = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican_service_user.cafile   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican_service_user.certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican_service_user.collect_timing = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican_service_user.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican_service_user.keyfile  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican_service_user.split_loggers = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] barbican_service_user.timeout  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.approle_role_id          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.approle_secret_id        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.cafile                   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.certfile                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.collect_timing           = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.insecure                 = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.keyfile                  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.kv_mountpoint            = secret {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.kv_path                  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.kv_version               = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.namespace                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.root_token_id            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.split_loggers            = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.ssl_ca_crt_file          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.timeout                  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.use_ssl                  = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.auth_section          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.auth_type             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.cafile                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.certfile              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.collect_timing        = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.connect_retries       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.connect_retry_delay   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.endpoint_override     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.insecure              = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.keyfile               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.max_version           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.min_version           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.region_name           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.service_name          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.service_type          = identity {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.split_loggers         = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.status_code_retries   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.status_code_retry_delay = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.timeout               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] keystone.version               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.connection_uri         =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.cpu_mode               = custom {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: WARNING oslo_config.cfg [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.cpu_power_governor_high = performance {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.cpu_power_governor_low = powersave {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.cpu_power_management   = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.device_detach_attempts = 8 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.device_detach_timeout  = 20 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.disk_cachemodes        = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.disk_prefix            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.enabled_perf_events    = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.file_backed_memory     = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.gid_maps               = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.hw_disk_discard        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.hw_machine_type        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.images_rbd_glance_store_name =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.images_rbd_pool        = rbd {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.images_type            = default {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.images_volume_group    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.inject_key             = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.inject_partition       = -2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.inject_password        = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.iscsi_iface            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.iser_use_multipath     = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.live_migration_bandwidth = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.live_migration_downtime = 500 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.live_migration_inbound_addr = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.live_migration_permit_post_copy = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.live_migration_scheme  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.live_migration_timeout_action = abort {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.live_migration_tunnelled = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: WARNING oslo_config.cfg [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 16 00:34:52 user nova-compute[75826]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 16 00:34:52 user nova-compute[75826]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 16 00:34:52 user nova-compute[75826]: and ``live_migration_inbound_addr`` respectively.
Nov 16 00:34:52 user nova-compute[75826]: ).  Its value may be silently ignored in the future.
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.live_migration_with_native_tls = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.max_queues             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.nfs_mount_options      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.num_memory_encrypted_guests = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.num_pcie_ports         = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.pmem_namespaces        = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.quobyte_client_cfg     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.rbd_secret_uuid        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.rbd_user               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.remote_filesystem_transport = ssh {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.rescue_image_id        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.rescue_kernel_id       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.rescue_ramdisk_id      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.rx_queue_size          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.smbfs_mount_options    =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.snapshot_compression   = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.snapshot_image_format  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.sparse_logical_volumes = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.swtpm_enabled          = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.swtpm_group            = tss {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.swtpm_user             = tss {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.sysinfo_serial         = unique {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.tb_cache_size          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.tx_queue_size          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.uid_maps               = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.use_virtio_for_bridges = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.virt_type              = kvm {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.volume_clear           = zero {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.volume_clear_size      = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.volume_use_multipath   = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.vzstorage_cache_path   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.vzstorage_mount_user   = stack {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.auth_section           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.auth_type              = password {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.cafile                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.certfile               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.collect_timing         = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.connect_retries        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.connect_retry_delay    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.default_floating_pool  = public {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.endpoint_override      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.extension_sync_interval = 600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.http_retries           = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.insecure               = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.keyfile                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.max_version            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.min_version            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.ovs_bridge             = br-int {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.physnets               = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.region_name            = RegionOne {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.service_metadata_proxy = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.service_name           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.service_type           = network {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.split_loggers          = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.status_code_retries    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.status_code_retry_delay = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.timeout                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] neutron.version                = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] notifications.bdms_in_notifications = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] notifications.default_level    = INFO {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] notifications.notification_format = unversioned {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] notifications.notify_on_state_change = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] pci.alias                      = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] pci.device_spec                = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] pci.report_in_placement        = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.auth_section         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.auth_type            = password {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.cafile               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.certfile             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.collect_timing       = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.connect_retries      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.connect_retry_delay  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.default_domain_id    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.default_domain_name  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.domain_id            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.domain_name          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.endpoint_override    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.insecure             = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.keyfile              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.max_version          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.min_version          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.password             = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.project_domain_id    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.project_domain_name  = Default {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.project_id           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.project_name         = service {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.region_name          = RegionOne {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.service_name         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.service_type         = placement {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.split_loggers        = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.status_code_retries  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.status_code_retry_delay = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.system_scope         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.timeout              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.trust_id             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.user_domain_id       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.user_domain_name     = Default {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.user_id              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.username             = placement {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] placement.version              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] quota.cores                    = 20 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] quota.count_usage_from_placement = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] quota.injected_file_content_bytes = 10240 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] quota.injected_file_path_length = 255 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] quota.injected_files           = 5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] quota.instances                = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] quota.key_pairs                = 100 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] quota.metadata_items           = 128 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] quota.ram                      = 51200 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] quota.recheck_quota            = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] quota.server_group_members     = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] quota.server_groups            = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] rdp.enabled                    = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] scheduler.image_metadata_prefilter = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] scheduler.max_attempts         = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] scheduler.max_placement_results = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] scheduler.query_placement_for_image_type_support = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] scheduler.workers              = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.host_subset_size = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.isolated_hosts = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.isolated_images = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.pci_in_placement = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.track_instance_changes = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] metrics.required               = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] metrics.weight_multiplier      = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] metrics.weight_setting         = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] serial_console.enabled         = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] serial_console.port_range      = 10000:20000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] serial_console.serialproxy_port = 6083 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] service_user.auth_section      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] service_user.auth_type         = password {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] service_user.cafile            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] service_user.certfile          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] service_user.collect_timing    = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] service_user.insecure          = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] service_user.keyfile           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] service_user.send_service_user_token = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] service_user.split_loggers     = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] service_user.timeout           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] spice.agent_enabled            = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] spice.enabled                  = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] spice.html5proxy_port          = 6082 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] spice.image_compression        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] spice.jpeg_compression         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] spice.playback_compression     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] spice.server_listen            = 127.0.0.1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] spice.streaming_mode           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] spice.zlib_compression         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] upgrade_levels.baseapi         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] upgrade_levels.cert            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] upgrade_levels.compute         = auto {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] upgrade_levels.conductor       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] upgrade_levels.scheduler       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vendordata_dynamic_auth.auth_section = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vendordata_dynamic_auth.auth_type = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vendordata_dynamic_auth.cafile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vendordata_dynamic_auth.certfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vendordata_dynamic_auth.insecure = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vendordata_dynamic_auth.keyfile = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vendordata_dynamic_auth.timeout = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.api_retry_count         = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.ca_file                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.cache_prefix            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.cluster_name            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.connection_pool_size    = 10 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.console_delay_seconds   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.datastore_regex         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.host_ip                 = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.host_password           = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.host_port               = 443 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.host_username           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.insecure                = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.integration_bridge      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.maximum_objects         = 100 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.pbm_default_policy      = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.pbm_enabled             = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.pbm_wsdl_location       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.serial_port_proxy_uri   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.serial_port_service_uri = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.task_poll_interval      = 0.5 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.use_linked_clone        = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.vnc_keymap              = en-us {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.vnc_port                = 5900 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vmware.vnc_port_total          = 10000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vnc.auth_schemes               = ['none'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vnc.enabled                    = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vnc.novncproxy_port            = 6080 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vnc.server_listen              = 0.0.0.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vnc.vencrypt_ca_certs          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vnc.vencrypt_client_cert       = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vnc.vencrypt_client_key        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.disable_rootwrap   = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.enable_numa_live_migration = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.libvirt_disable_apic = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] wsgi.client_socket_timeout     = 900 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] wsgi.default_pool_size         = 1000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] wsgi.keep_alive                = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] wsgi.max_header_line           = 16384 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] wsgi.ssl_ca_file               = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] wsgi.ssl_cert_file             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] wsgi.ssl_key_file              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] wsgi.tcp_keepidle              = 600 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] zvm.ca_file                    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] zvm.cloud_connector_url        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] zvm.reachable_timeout          = 300 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_policy.enforce_new_defaults = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_policy.enforce_scope      = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_policy.policy_default_rule = default {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_policy.policy_file        = policy.yaml {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler.connection_string     = messaging:// {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler.enabled               = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler.es_doc_type           = notification {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler.es_scroll_size        = 10000 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler.es_scroll_time        = 2m {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler.filter_error_trace    = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler.hmac_keys             = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler.sentinel_service_name = mymaster {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler.socket_timeout        = 0.1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler.trace_requests        = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler.trace_sqlalchemy      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler_jaeger.process_tags   = {} {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler_jaeger.service_name_prefix = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] profiler_otlp.service_name_prefix = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] remote_debug.host              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] remote_debug.port              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.ssl      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_notifications.retry = -1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_messaging_notifications.transport_url = **** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.auth_section        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.auth_type           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.cafile              = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.certfile            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.collect_timing      = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.connect_retries     = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.connect_retry_delay = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.endpoint_id         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.endpoint_override   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.insecure            = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.keyfile             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.max_version         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.min_version         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.region_name         = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.service_name        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.service_type        = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.split_loggers       = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.status_code_retries = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.status_code_retry_delay = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.timeout             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.valid_interfaces    = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_limit.version             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_reports.file_event_handler = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] oslo_reports.log_dir           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plug_ovs_privileged.group  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] vif_plug_ovs_privileged.user   = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_linux_bridge.flat_interface = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_ovs.isolate_vif         = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_vif_ovs.per_port_bridge     = False {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] os_brick.lock_path             = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] privsep_osbrick.capabilities   = [21] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] privsep_osbrick.group          = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] privsep_osbrick.helper_command = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] privsep_osbrick.user           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] nova_sys_admin.group           = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] nova_sys_admin.helper_command  = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] nova_sys_admin.user            = None {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG oslo_service.service [None req-1d20f5fc-a285-48c7-a9fb-e76715fd3aed None None] ******************************************************************************** {{(pid=75826) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 16 00:34:52 user nova-compute[75826]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 16 00:34:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Connecting to libvirt: qemu:///system {{(pid=75826) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fcdbc1ea9b0> {{(pid=75826) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 16 00:34:52 user nova-compute[75826]: libvirt:  error : internal error: could not initialize domain event timer
Nov 16 00:34:52 user nova-compute[75826]: WARNING nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 16 00:34:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fcdbc1ea9b0> {{(pid=75826) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Starting native event thread {{(pid=75826) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Starting green dispatch thread {{(pid=75826) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 16 00:34:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Starting connection event dispatch thread {{(pid=75826) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 16 00:34:52 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Connection event '1' reason 'None'
Nov 16 00:34:52 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 00:34:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.mount [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Initialising _HostMountState generation 0 {{(pid=75826) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 16 00:34:59 user nova-compute[75826]: INFO nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Libvirt host capabilities <capabilities>
Nov 16 00:34:59 user nova-compute[75826]:   <host>
Nov 16 00:34:59 user nova-compute[75826]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 16 00:34:59 user nova-compute[75826]:     <cpu>
Nov 16 00:34:59 user nova-compute[75826]:       <arch>x86_64</arch>
Nov 16 00:34:59 user nova-compute[75826]:       <model>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <vendor>Intel</vendor>
Nov 16 00:34:59 user nova-compute[75826]:       <microcode version='1070'/>
Nov 16 00:34:59 user nova-compute[75826]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 16 00:34:59 user nova-compute[75826]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='ss'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='vmx'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='pcid'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='osxsave'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='hypervisor'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='arat'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='tsc_adjust'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='md-clear'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='arch-capabilities'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='invtsc'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='rsba'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature name='skip-l1dfl-vmentry'/>
Nov 16 00:34:59 user nova-compute[75826]:       <pages unit='KiB' size='4'/>
Nov 16 00:34:59 user nova-compute[75826]:       <pages unit='KiB' size='2048'/>
Nov 16 00:34:59 user nova-compute[75826]:     </cpu>
Nov 16 00:34:59 user nova-compute[75826]:     <power_management>
Nov 16 00:34:59 user nova-compute[75826]:       <suspend_mem/>
Nov 16 00:34:59 user nova-compute[75826]:       <suspend_disk/>
Nov 16 00:34:59 user nova-compute[75826]:       <suspend_hybrid/>
Nov 16 00:34:59 user nova-compute[75826]:     </power_management>
Nov 16 00:34:59 user nova-compute[75826]:     <iommu support='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     <migration_features>
Nov 16 00:34:59 user nova-compute[75826]:       <live/>
Nov 16 00:34:59 user nova-compute[75826]:       <uri_transports>
Nov 16 00:34:59 user nova-compute[75826]:         <uri_transport>tcp</uri_transport>
Nov 16 00:34:59 user nova-compute[75826]:         <uri_transport>rdma</uri_transport>
Nov 16 00:34:59 user nova-compute[75826]:       </uri_transports>
Nov 16 00:34:59 user nova-compute[75826]:     </migration_features>
Nov 16 00:34:59 user nova-compute[75826]:     <topology>
Nov 16 00:34:59 user nova-compute[75826]:       <cells num='2'>
Nov 16 00:34:59 user nova-compute[75826]:         <cell id='0'>
Nov 16 00:34:59 user nova-compute[75826]:           <memory unit='KiB'>8140616</memory>
Nov 16 00:34:59 user nova-compute[75826]:           <pages unit='KiB' size='4'>2035154</pages>
Nov 16 00:34:59 user nova-compute[75826]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 00:34:59 user nova-compute[75826]:           <distances>
Nov 16 00:34:59 user nova-compute[75826]:             <sibling id='0' value='10'/>
Nov 16 00:34:59 user nova-compute[75826]:             <sibling id='1' value='20'/>
Nov 16 00:34:59 user nova-compute[75826]:           </distances>
Nov 16 00:34:59 user nova-compute[75826]:           <cpus num='6'>
Nov 16 00:34:59 user nova-compute[75826]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 16 00:34:59 user nova-compute[75826]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 16 00:34:59 user nova-compute[75826]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 16 00:34:59 user nova-compute[75826]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 16 00:34:59 user nova-compute[75826]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 16 00:34:59 user nova-compute[75826]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 16 00:34:59 user nova-compute[75826]:           </cpus>
Nov 16 00:34:59 user nova-compute[75826]:         </cell>
Nov 16 00:34:59 user nova-compute[75826]:         <cell id='1'>
Nov 16 00:34:59 user nova-compute[75826]:           <memory unit='KiB'>8255068</memory>
Nov 16 00:34:59 user nova-compute[75826]:           <pages unit='KiB' size='4'>2063767</pages>
Nov 16 00:34:59 user nova-compute[75826]:           <pages unit='KiB' size='2048'>0</pages>
Nov 16 00:34:59 user nova-compute[75826]:           <distances>
Nov 16 00:34:59 user nova-compute[75826]:             <sibling id='0' value='20'/>
Nov 16 00:34:59 user nova-compute[75826]:             <sibling id='1' value='10'/>
Nov 16 00:34:59 user nova-compute[75826]:           </distances>
Nov 16 00:34:59 user nova-compute[75826]:           <cpus num='6'>
Nov 16 00:34:59 user nova-compute[75826]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 16 00:34:59 user nova-compute[75826]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 16 00:34:59 user nova-compute[75826]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 16 00:34:59 user nova-compute[75826]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 16 00:34:59 user nova-compute[75826]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 16 00:34:59 user nova-compute[75826]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 16 00:34:59 user nova-compute[75826]:           </cpus>
Nov 16 00:34:59 user nova-compute[75826]:         </cell>
Nov 16 00:34:59 user nova-compute[75826]:       </cells>
Nov 16 00:34:59 user nova-compute[75826]:     </topology>
Nov 16 00:34:59 user nova-compute[75826]:     <cache>
Nov 16 00:34:59 user nova-compute[75826]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 16 00:34:59 user nova-compute[75826]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 16 00:34:59 user nova-compute[75826]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 16 00:34:59 user nova-compute[75826]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 16 00:34:59 user nova-compute[75826]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 16 00:34:59 user nova-compute[75826]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 16 00:34:59 user nova-compute[75826]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 16 00:34:59 user nova-compute[75826]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 16 00:34:59 user nova-compute[75826]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 16 00:34:59 user nova-compute[75826]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 16 00:34:59 user nova-compute[75826]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 16 00:34:59 user nova-compute[75826]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 16 00:34:59 user nova-compute[75826]:     </cache>
Nov 16 00:34:59 user nova-compute[75826]:     <secmodel>
Nov 16 00:34:59 user nova-compute[75826]:       <model>apparmor</model>
Nov 16 00:34:59 user nova-compute[75826]:       <doi>0</doi>
Nov 16 00:34:59 user nova-compute[75826]:     </secmodel>
Nov 16 00:34:59 user nova-compute[75826]:     <secmodel>
Nov 16 00:34:59 user nova-compute[75826]:       <model>dac</model>
Nov 16 00:34:59 user nova-compute[75826]:       <doi>0</doi>
Nov 16 00:34:59 user nova-compute[75826]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 16 00:34:59 user nova-compute[75826]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 16 00:34:59 user nova-compute[75826]:     </secmodel>
Nov 16 00:34:59 user nova-compute[75826]:   </host>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='alpha'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>64</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>clipper</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='armv6l'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>spitz</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>nuri</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>kzm</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sx1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>z2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>tosa</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>n810</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>n800</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>terrier</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>midway</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>microbit</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>verdex</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>highbank</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>akita</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>connex</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>collie</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='armv7l'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>spitz</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>nuri</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>kzm</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sx1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>z2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>tosa</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>n810</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>n800</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>terrier</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>midway</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>microbit</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>verdex</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>highbank</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>akita</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>connex</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>collie</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='aarch64'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>64</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>integratorcp</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>borzoi</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>spitz</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>nuri</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>musca-b1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>versatileab</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>kzm</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>musca-a</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>smdkc210</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sx1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>z2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>tosa</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>sabrelite</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>realview-eb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>n810</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>n800</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>versatilepb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>terrier</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mainstone</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>midway</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>musicpal</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>microbit</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>cubieboard</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>verdex</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>netduino2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>raspi3b</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>raspi2b</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>cheetah</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>highbank</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>akita</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>connex</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>collie</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>raspi0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <acpi default='on' toggle='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='cris'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='i686'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>isapc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>microvm</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='kvm'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <pae/>
Nov 16 00:34:59 user nova-compute[75826]:       <nonpae/>
Nov 16 00:34:59 user nova-compute[75826]:       <acpi default='on' toggle='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:       <apic default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='m68k'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>an5206</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>q800</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>next-cube</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='microblaze'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='microblazeel'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='mips'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='16'>malta</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='mipsel'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='16'>malta</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='mips64'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>64</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='16'>malta</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>pica61</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>magnum</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='mips64el'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>64</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='16'>malta</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mipssim</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>pica61</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>magnum</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='16'>boston</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='ppc'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mac99</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>40p</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>taihu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='ppc64'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>64</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>taihu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>40p</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mac99</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='ppc64le'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>64</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2048'>powernv9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>taihu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2048'>powernv10</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>ppce500</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>40p</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>pegasos2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>bamboo</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>g3beige</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>mac99</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sam460ex</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>ref405ep</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2048'>powernv8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='riscv32'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='8'>spike</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>opentitan</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='8'>virt</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='riscv64'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>64</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='8'>spike</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='5'>sifive_u</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>shakti_c</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sifive_e</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='8'>virt</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='s390x'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>64</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='sh4'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>shix</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>r2d</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='sh4eb'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>64</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>shix</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>r2d</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='sparc'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>SS-5</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>SS-20</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>LX</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>SS-4</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>SS-10</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>Voyager</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='sparc64'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>64</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sun4u</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>niagara</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>sun4v</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='x86_64'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>64</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>x-remote</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='1'>isapc</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>microvm</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='kvm'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <acpi default='on' toggle='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:       <apic default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='xtensa'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>sim</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>kc705</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>ml605</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>virt</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>lx200</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>lx60</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]:   <guest>
Nov 16 00:34:59 user nova-compute[75826]:     <os_type>hvm</os_type>
Nov 16 00:34:59 user nova-compute[75826]:     <arch name='xtensaeb'>
Nov 16 00:34:59 user nova-compute[75826]:       <wordsize>32</wordsize>
Nov 16 00:34:59 user nova-compute[75826]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='4'>sim</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>kc705</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>ml605</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>virt</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>lx200</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>lx60</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 16 00:34:59 user nova-compute[75826]:       <domain type='qemu'/>
Nov 16 00:34:59 user nova-compute[75826]:     </arch>
Nov 16 00:34:59 user nova-compute[75826]:     <features>
Nov 16 00:34:59 user nova-compute[75826]:       <cpuselection/>
Nov 16 00:34:59 user nova-compute[75826]:       <deviceboot/>
Nov 16 00:34:59 user nova-compute[75826]:       <disksnapshot default='on' toggle='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     </features>
Nov 16 00:34:59 user nova-compute[75826]:   </guest>
Nov 16 00:34:59 user nova-compute[75826]: </capabilities>
Nov 16 00:34:59 user nova-compute[75826]: 
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 16 00:34:59 user nova-compute[75826]: <domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 00:34:59 user nova-compute[75826]:   <domain>kvm</domain>
Nov 16 00:34:59 user nova-compute[75826]:   <machine>pc-i440fx-jammy</machine>
Nov 16 00:34:59 user nova-compute[75826]:   <arch>i686</arch>
Nov 16 00:34:59 user nova-compute[75826]:   <vcpu max='255'/>
Nov 16 00:34:59 user nova-compute[75826]:   <iothreads supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:   <os supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='firmware'/>
Nov 16 00:34:59 user nova-compute[75826]:     <loader supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>rom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pflash</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='readonly'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>yes</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='secure'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </loader>
Nov 16 00:34:59 user nova-compute[75826]:   </os>
Nov 16 00:34:59 user nova-compute[75826]:   <cpu>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-passthrough' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='hostPassthroughMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='maximum' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='maximumMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>on</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-model' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <vendor>Intel</vendor>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ss'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='vmx'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='pcid'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='hypervisor'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arat'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='umip'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='md-clear'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibpb'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibrs'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='erms'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='lm'/>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='custom' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>qemu64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>qemu32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>phenom</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>n270</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>kvm64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>kvm32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>coreduo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>core2duo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>athlon</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Westmere</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Snowridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Penryn</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G5</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G4</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G1</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Nehalem</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Rome</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Milan</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Dhyana</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cooperlake</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Conroe</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>486</model>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:   </cpu>
Nov 16 00:34:59 user nova-compute[75826]:   <memoryBacking supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='sourceType'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>file</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>anonymous</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>memfd</value>
Nov 16 00:34:59 user nova-compute[75826]:     </enum>
Nov 16 00:34:59 user nova-compute[75826]:   </memoryBacking>
Nov 16 00:34:59 user nova-compute[75826]:   <devices>
Nov 16 00:34:59 user nova-compute[75826]:     <disk supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='diskDevice'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>disk</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cdrom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>floppy</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>lun</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='bus'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>ide</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>fdc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sata</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </disk>
Nov 16 00:34:59 user nova-compute[75826]:     <graphics supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sdl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vnc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>spice</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egl-headless</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </graphics>
Nov 16 00:34:59 user nova-compute[75826]:     <video supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='modelType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cirrus</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vmvga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>qxl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>none</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>bochs</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>ramfb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </video>
Nov 16 00:34:59 user nova-compute[75826]:     <hostdev supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='mode'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>subsystem</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='startupPolicy'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>default</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>mandatory</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>requisite</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>optional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='subsysType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pci</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='capsType'/>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='pciBackend'/>
Nov 16 00:34:59 user nova-compute[75826]:     </hostdev>
Nov 16 00:34:59 user nova-compute[75826]:     <rng supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>random</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egd</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>builtin</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </rng>
Nov 16 00:34:59 user nova-compute[75826]:     <filesystem supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='driverType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>path</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>handle</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtiofs</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </filesystem>
Nov 16 00:34:59 user nova-compute[75826]:     <tpm supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-tis</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-crb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>passthrough</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>emulator</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </tpm>
Nov 16 00:34:59 user nova-compute[75826]:   </devices>
Nov 16 00:34:59 user nova-compute[75826]:   <features>
Nov 16 00:34:59 user nova-compute[75826]:     <gic supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     <vmcoreinfo supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <genid supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backingStoreInput supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backup supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <sev supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:   </features>
Nov 16 00:34:59 user nova-compute[75826]: </domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:  {{(pid=75826) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 16 00:34:59 user nova-compute[75826]: <domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 00:34:59 user nova-compute[75826]:   <domain>kvm</domain>
Nov 16 00:34:59 user nova-compute[75826]:   <machine>pc-q35-jammy</machine>
Nov 16 00:34:59 user nova-compute[75826]:   <arch>i686</arch>
Nov 16 00:34:59 user nova-compute[75826]:   <vcpu max='288'/>
Nov 16 00:34:59 user nova-compute[75826]:   <iothreads supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:   <os supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='firmware'/>
Nov 16 00:34:59 user nova-compute[75826]:     <loader supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>rom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pflash</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='readonly'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>yes</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='secure'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </loader>
Nov 16 00:34:59 user nova-compute[75826]:   </os>
Nov 16 00:34:59 user nova-compute[75826]:   <cpu>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-passthrough' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='hostPassthroughMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='maximum' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='maximumMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>on</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-model' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <vendor>Intel</vendor>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ss'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='vmx'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='pcid'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='hypervisor'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arat'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='umip'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='md-clear'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibpb'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibrs'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='erms'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='lm'/>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='custom' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>qemu64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>qemu32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>phenom</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>n270</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>kvm64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>kvm32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>coreduo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>core2duo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>athlon</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Westmere</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Snowridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Penryn</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G5</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G4</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G1</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Nehalem</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Rome</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Milan</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Dhyana</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cooperlake</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Conroe</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>486</model>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:   </cpu>
Nov 16 00:34:59 user nova-compute[75826]:   <memoryBacking supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='sourceType'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>file</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>anonymous</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>memfd</value>
Nov 16 00:34:59 user nova-compute[75826]:     </enum>
Nov 16 00:34:59 user nova-compute[75826]:   </memoryBacking>
Nov 16 00:34:59 user nova-compute[75826]:   <devices>
Nov 16 00:34:59 user nova-compute[75826]:     <disk supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='diskDevice'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>disk</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cdrom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>floppy</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>lun</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='bus'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>fdc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sata</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </disk>
Nov 16 00:34:59 user nova-compute[75826]:     <graphics supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sdl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vnc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>spice</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egl-headless</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </graphics>
Nov 16 00:34:59 user nova-compute[75826]:     <video supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='modelType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cirrus</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vmvga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>qxl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>none</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>bochs</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>ramfb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </video>
Nov 16 00:34:59 user nova-compute[75826]:     <hostdev supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='mode'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>subsystem</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='startupPolicy'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>default</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>mandatory</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>requisite</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>optional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='subsysType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pci</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='capsType'/>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='pciBackend'/>
Nov 16 00:34:59 user nova-compute[75826]:     </hostdev>
Nov 16 00:34:59 user nova-compute[75826]:     <rng supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>random</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egd</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>builtin</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </rng>
Nov 16 00:34:59 user nova-compute[75826]:     <filesystem supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='driverType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>path</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>handle</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtiofs</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </filesystem>
Nov 16 00:34:59 user nova-compute[75826]:     <tpm supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-tis</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-crb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>passthrough</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>emulator</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </tpm>
Nov 16 00:34:59 user nova-compute[75826]:   </devices>
Nov 16 00:34:59 user nova-compute[75826]:   <features>
Nov 16 00:34:59 user nova-compute[75826]:     <gic supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     <vmcoreinfo supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <genid supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backingStoreInput supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backup supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <sev supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:   </features>
Nov 16 00:34:59 user nova-compute[75826]: </domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:  {{(pid=75826) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 16 00:34:59 user nova-compute[75826]: <domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 00:34:59 user nova-compute[75826]:   <domain>kvm</domain>
Nov 16 00:34:59 user nova-compute[75826]:   <machine>pc-q35-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:   <arch>i686</arch>
Nov 16 00:34:59 user nova-compute[75826]:   <vcpu max='288'/>
Nov 16 00:34:59 user nova-compute[75826]:   <iothreads supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:   <os supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='firmware'/>
Nov 16 00:34:59 user nova-compute[75826]:     <loader supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>rom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pflash</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='readonly'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>yes</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='secure'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </loader>
Nov 16 00:34:59 user nova-compute[75826]:   </os>
Nov 16 00:34:59 user nova-compute[75826]:   <cpu>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-passthrough' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='hostPassthroughMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='maximum' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='maximumMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>on</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-model' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <vendor>Intel</vendor>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ss'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='vmx'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='pcid'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='hypervisor'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arat'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='umip'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='md-clear'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibpb'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibrs'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='erms'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='lm'/>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='custom' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>qemu64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>qemu32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>phenom</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>n270</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>kvm64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>kvm32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>coreduo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>core2duo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>athlon</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Westmere</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Snowridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Penryn</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G5</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G4</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G1</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Nehalem</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Rome</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Milan</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Dhyana</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cooperlake</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Conroe</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>486</model>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:   </cpu>
Nov 16 00:34:59 user nova-compute[75826]:   <memoryBacking supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='sourceType'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>file</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>anonymous</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>memfd</value>
Nov 16 00:34:59 user nova-compute[75826]:     </enum>
Nov 16 00:34:59 user nova-compute[75826]:   </memoryBacking>
Nov 16 00:34:59 user nova-compute[75826]:   <devices>
Nov 16 00:34:59 user nova-compute[75826]:     <disk supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='diskDevice'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>disk</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cdrom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>floppy</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>lun</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='bus'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>fdc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sata</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </disk>
Nov 16 00:34:59 user nova-compute[75826]:     <graphics supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sdl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vnc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>spice</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egl-headless</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </graphics>
Nov 16 00:34:59 user nova-compute[75826]:     <video supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='modelType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cirrus</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vmvga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>qxl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>none</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>bochs</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>ramfb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </video>
Nov 16 00:34:59 user nova-compute[75826]:     <hostdev supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='mode'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>subsystem</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='startupPolicy'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>default</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>mandatory</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>requisite</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>optional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='subsysType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pci</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='capsType'/>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='pciBackend'/>
Nov 16 00:34:59 user nova-compute[75826]:     </hostdev>
Nov 16 00:34:59 user nova-compute[75826]:     <rng supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>random</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egd</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>builtin</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </rng>
Nov 16 00:34:59 user nova-compute[75826]:     <filesystem supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='driverType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>path</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>handle</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtiofs</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </filesystem>
Nov 16 00:34:59 user nova-compute[75826]:     <tpm supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-tis</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-crb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>passthrough</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>emulator</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </tpm>
Nov 16 00:34:59 user nova-compute[75826]:   </devices>
Nov 16 00:34:59 user nova-compute[75826]:   <features>
Nov 16 00:34:59 user nova-compute[75826]:     <gic supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     <vmcoreinfo supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <genid supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backingStoreInput supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backup supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <sev supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:   </features>
Nov 16 00:34:59 user nova-compute[75826]: </domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:  {{(pid=75826) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 16 00:34:59 user nova-compute[75826]: <domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:   <path>/usr/bin/qemu-system-i386</path>
Nov 16 00:34:59 user nova-compute[75826]:   <domain>kvm</domain>
Nov 16 00:34:59 user nova-compute[75826]:   <machine>pc-i440fx-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:   <arch>i686</arch>
Nov 16 00:34:59 user nova-compute[75826]:   <vcpu max='255'/>
Nov 16 00:34:59 user nova-compute[75826]:   <iothreads supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:   <os supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='firmware'/>
Nov 16 00:34:59 user nova-compute[75826]:     <loader supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>rom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pflash</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='readonly'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>yes</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='secure'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </loader>
Nov 16 00:34:59 user nova-compute[75826]:   </os>
Nov 16 00:34:59 user nova-compute[75826]:   <cpu>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-passthrough' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='hostPassthroughMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='maximum' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='maximumMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>on</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-model' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <vendor>Intel</vendor>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ss'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='vmx'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='pcid'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='hypervisor'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arat'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='umip'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='md-clear'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibpb'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibrs'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='erms'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='lm'/>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='custom' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>qemu64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>qemu32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>phenom</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>n270</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>kvm64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>kvm32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>coreduo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>core2duo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>athlon</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Westmere-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Westmere</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Snowridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Penryn</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G5</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G4</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G1</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Nehalem-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Nehalem</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Rome</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Milan</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Dhyana</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cooperlake</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Conroe</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>486</model>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:   </cpu>
Nov 16 00:34:59 user nova-compute[75826]:   <memoryBacking supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='sourceType'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>file</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>anonymous</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>memfd</value>
Nov 16 00:34:59 user nova-compute[75826]:     </enum>
Nov 16 00:34:59 user nova-compute[75826]:   </memoryBacking>
Nov 16 00:34:59 user nova-compute[75826]:   <devices>
Nov 16 00:34:59 user nova-compute[75826]:     <disk supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='diskDevice'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>disk</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cdrom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>floppy</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>lun</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='bus'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>ide</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>fdc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sata</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </disk>
Nov 16 00:34:59 user nova-compute[75826]:     <graphics supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sdl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vnc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>spice</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egl-headless</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </graphics>
Nov 16 00:34:59 user nova-compute[75826]:     <video supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='modelType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cirrus</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vmvga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>qxl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>none</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>bochs</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>ramfb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </video>
Nov 16 00:34:59 user nova-compute[75826]:     <hostdev supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='mode'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>subsystem</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='startupPolicy'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>default</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>mandatory</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>requisite</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>optional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='subsysType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pci</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='capsType'/>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='pciBackend'/>
Nov 16 00:34:59 user nova-compute[75826]:     </hostdev>
Nov 16 00:34:59 user nova-compute[75826]:     <rng supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>random</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egd</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>builtin</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </rng>
Nov 16 00:34:59 user nova-compute[75826]:     <filesystem supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='driverType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>path</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>handle</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtiofs</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </filesystem>
Nov 16 00:34:59 user nova-compute[75826]:     <tpm supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-tis</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-crb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>passthrough</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>emulator</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </tpm>
Nov 16 00:34:59 user nova-compute[75826]:   </devices>
Nov 16 00:34:59 user nova-compute[75826]:   <features>
Nov 16 00:34:59 user nova-compute[75826]:     <gic supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     <vmcoreinfo supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <genid supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backingStoreInput supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backup supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <sev supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:   </features>
Nov 16 00:34:59 user nova-compute[75826]: </domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:  {{(pid=75826) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'q35', 'pc'} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 16 00:34:59 user nova-compute[75826]: <domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 00:34:59 user nova-compute[75826]:   <domain>kvm</domain>
Nov 16 00:34:59 user nova-compute[75826]:   <machine>pc-i440fx-jammy</machine>
Nov 16 00:34:59 user nova-compute[75826]:   <arch>x86_64</arch>
Nov 16 00:34:59 user nova-compute[75826]:   <vcpu max='255'/>
Nov 16 00:34:59 user nova-compute[75826]:   <iothreads supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:   <os supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='firmware'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>efi</value>
Nov 16 00:34:59 user nova-compute[75826]:     </enum>
Nov 16 00:34:59 user nova-compute[75826]:     <loader supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>rom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pflash</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='readonly'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>yes</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='secure'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </loader>
Nov 16 00:34:59 user nova-compute[75826]:   </os>
Nov 16 00:34:59 user nova-compute[75826]:   <cpu>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-passthrough' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='hostPassthroughMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>on</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='maximum' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='maximumMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>on</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-model' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <vendor>Intel</vendor>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ss'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='vmx'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='pcid'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='hypervisor'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arat'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='umip'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='md-clear'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='invtsc'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibpb'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibrs'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='rsba'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='erms'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='custom' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>qemu64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>qemu32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>phenom</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>n270</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>kvm64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>kvm32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>coreduo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>core2duo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>athlon</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Westmere</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Snowridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Penryn</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G5</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G4</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Opteron_G1</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Nehalem</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Rome</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Milan</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Dhyana</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cooperlake</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Conroe</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>486</model>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:   </cpu>
Nov 16 00:34:59 user nova-compute[75826]:   <memoryBacking supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='sourceType'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>file</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>anonymous</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>memfd</value>
Nov 16 00:34:59 user nova-compute[75826]:     </enum>
Nov 16 00:34:59 user nova-compute[75826]:   </memoryBacking>
Nov 16 00:34:59 user nova-compute[75826]:   <devices>
Nov 16 00:34:59 user nova-compute[75826]:     <disk supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='diskDevice'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>disk</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cdrom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>floppy</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>lun</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='bus'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>ide</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>fdc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sata</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </disk>
Nov 16 00:34:59 user nova-compute[75826]:     <graphics supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sdl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vnc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>spice</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egl-headless</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </graphics>
Nov 16 00:34:59 user nova-compute[75826]:     <video supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='modelType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cirrus</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vmvga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>qxl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>none</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>bochs</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>ramfb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </video>
Nov 16 00:34:59 user nova-compute[75826]:     <hostdev supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='mode'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>subsystem</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='startupPolicy'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>default</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>mandatory</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>requisite</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>optional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='subsysType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pci</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='capsType'/>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='pciBackend'/>
Nov 16 00:34:59 user nova-compute[75826]:     </hostdev>
Nov 16 00:34:59 user nova-compute[75826]:     <rng supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>random</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egd</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>builtin</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </rng>
Nov 16 00:34:59 user nova-compute[75826]:     <filesystem supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='driverType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>path</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>handle</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtiofs</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </filesystem>
Nov 16 00:34:59 user nova-compute[75826]:     <tpm supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-tis</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-crb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>passthrough</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>emulator</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </tpm>
Nov 16 00:34:59 user nova-compute[75826]:   </devices>
Nov 16 00:34:59 user nova-compute[75826]:   <features>
Nov 16 00:34:59 user nova-compute[75826]:     <gic supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     <vmcoreinfo supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <genid supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backingStoreInput supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backup supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <sev supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:   </features>
Nov 16 00:34:59 user nova-compute[75826]: </domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:  {{(pid=75826) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 16 00:34:59 user nova-compute[75826]: <domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 00:34:59 user nova-compute[75826]:   <domain>kvm</domain>
Nov 16 00:34:59 user nova-compute[75826]:   <machine>pc-q35-jammy</machine>
Nov 16 00:34:59 user nova-compute[75826]:   <arch>x86_64</arch>
Nov 16 00:34:59 user nova-compute[75826]:   <vcpu max='288'/>
Nov 16 00:34:59 user nova-compute[75826]:   <iothreads supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:   <os supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='firmware'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>efi</value>
Nov 16 00:34:59 user nova-compute[75826]:     </enum>
Nov 16 00:34:59 user nova-compute[75826]:     <loader supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>rom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pflash</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='readonly'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>yes</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='secure'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>yes</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </loader>
Nov 16 00:34:59 user nova-compute[75826]:   </os>
Nov 16 00:34:59 user nova-compute[75826]:   <cpu>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-passthrough' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='hostPassthroughMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>on</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='maximum' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='maximumMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>on</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-model' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <vendor>Intel</vendor>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ss'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='vmx'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='pcid'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='hypervisor'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arat'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='umip'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='md-clear'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='invtsc'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibpb'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibrs'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='rsba'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='erms'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='custom' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>qemu64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>qemu32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>phenom</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>n270</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>kvm64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>kvm32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>coreduo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>core2duo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>athlon</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Westmere</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Snowridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Penryn</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G5</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G4</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Opteron_G1</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Nehalem</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Rome</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Milan</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Dhyana</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cooperlake</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Conroe</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>486</model>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:   </cpu>
Nov 16 00:34:59 user nova-compute[75826]:   <memoryBacking supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='sourceType'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>file</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>anonymous</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>memfd</value>
Nov 16 00:34:59 user nova-compute[75826]:     </enum>
Nov 16 00:34:59 user nova-compute[75826]:   </memoryBacking>
Nov 16 00:34:59 user nova-compute[75826]:   <devices>
Nov 16 00:34:59 user nova-compute[75826]:     <disk supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='diskDevice'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>disk</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cdrom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>floppy</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>lun</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='bus'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>fdc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sata</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </disk>
Nov 16 00:34:59 user nova-compute[75826]:     <graphics supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sdl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vnc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>spice</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egl-headless</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </graphics>
Nov 16 00:34:59 user nova-compute[75826]:     <video supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='modelType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cirrus</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vmvga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>qxl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>none</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>bochs</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>ramfb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </video>
Nov 16 00:34:59 user nova-compute[75826]:     <hostdev supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='mode'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>subsystem</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='startupPolicy'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>default</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>mandatory</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>requisite</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>optional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='subsysType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pci</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='capsType'/>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='pciBackend'/>
Nov 16 00:34:59 user nova-compute[75826]:     </hostdev>
Nov 16 00:34:59 user nova-compute[75826]:     <rng supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>random</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egd</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>builtin</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </rng>
Nov 16 00:34:59 user nova-compute[75826]:     <filesystem supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='driverType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>path</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>handle</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtiofs</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </filesystem>
Nov 16 00:34:59 user nova-compute[75826]:     <tpm supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-tis</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-crb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>passthrough</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>emulator</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </tpm>
Nov 16 00:34:59 user nova-compute[75826]:   </devices>
Nov 16 00:34:59 user nova-compute[75826]:   <features>
Nov 16 00:34:59 user nova-compute[75826]:     <gic supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     <vmcoreinfo supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <genid supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backingStoreInput supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backup supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <sev supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:   </features>
Nov 16 00:34:59 user nova-compute[75826]: </domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:  {{(pid=75826) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 16 00:34:59 user nova-compute[75826]: <domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 00:34:59 user nova-compute[75826]:   <domain>kvm</domain>
Nov 16 00:34:59 user nova-compute[75826]:   <machine>pc-q35-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:   <arch>x86_64</arch>
Nov 16 00:34:59 user nova-compute[75826]:   <vcpu max='288'/>
Nov 16 00:34:59 user nova-compute[75826]:   <iothreads supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:   <os supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='firmware'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>efi</value>
Nov 16 00:34:59 user nova-compute[75826]:     </enum>
Nov 16 00:34:59 user nova-compute[75826]:     <loader supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>rom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pflash</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='readonly'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>yes</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='secure'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>yes</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </loader>
Nov 16 00:34:59 user nova-compute[75826]:   </os>
Nov 16 00:34:59 user nova-compute[75826]:   <cpu>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-passthrough' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='hostPassthroughMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>on</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='maximum' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='maximumMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>on</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-model' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <vendor>Intel</vendor>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ss'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='vmx'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='pcid'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='hypervisor'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arat'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='umip'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='md-clear'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='invtsc'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibpb'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibrs'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='rsba'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='erms'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='custom' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>qemu64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>qemu32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>phenom</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>n270</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>kvm64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>kvm32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>coreduo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>core2duo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>athlon</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Westmere</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Snowridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Penryn</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G5</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G4</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Opteron_G1</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Nehalem</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Rome</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Milan</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Dhyana</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cooperlake</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Conroe</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>486</model>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:   </cpu>
Nov 16 00:34:59 user nova-compute[75826]:   <memoryBacking supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='sourceType'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>file</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>anonymous</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>memfd</value>
Nov 16 00:34:59 user nova-compute[75826]:     </enum>
Nov 16 00:34:59 user nova-compute[75826]:   </memoryBacking>
Nov 16 00:34:59 user nova-compute[75826]:   <devices>
Nov 16 00:34:59 user nova-compute[75826]:     <disk supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='diskDevice'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>disk</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cdrom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>floppy</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>lun</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='bus'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>fdc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sata</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </disk>
Nov 16 00:34:59 user nova-compute[75826]:     <graphics supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sdl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vnc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>spice</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egl-headless</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </graphics>
Nov 16 00:34:59 user nova-compute[75826]:     <video supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='modelType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cirrus</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vmvga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>qxl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>none</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>bochs</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>ramfb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </video>
Nov 16 00:34:59 user nova-compute[75826]:     <hostdev supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='mode'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>subsystem</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='startupPolicy'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>default</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>mandatory</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>requisite</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>optional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='subsysType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pci</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='capsType'/>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='pciBackend'/>
Nov 16 00:34:59 user nova-compute[75826]:     </hostdev>
Nov 16 00:34:59 user nova-compute[75826]:     <rng supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>random</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egd</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>builtin</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </rng>
Nov 16 00:34:59 user nova-compute[75826]:     <filesystem supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='driverType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>path</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>handle</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtiofs</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </filesystem>
Nov 16 00:34:59 user nova-compute[75826]:     <tpm supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-tis</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-crb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>passthrough</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>emulator</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </tpm>
Nov 16 00:34:59 user nova-compute[75826]:   </devices>
Nov 16 00:34:59 user nova-compute[75826]:   <features>
Nov 16 00:34:59 user nova-compute[75826]:     <gic supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     <vmcoreinfo supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <genid supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backingStoreInput supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backup supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <sev supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:   </features>
Nov 16 00:34:59 user nova-compute[75826]: </domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:  {{(pid=75826) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 16 00:34:59 user nova-compute[75826]: <domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 16 00:34:59 user nova-compute[75826]:   <domain>kvm</domain>
Nov 16 00:34:59 user nova-compute[75826]:   <machine>pc-i440fx-6.2</machine>
Nov 16 00:34:59 user nova-compute[75826]:   <arch>x86_64</arch>
Nov 16 00:34:59 user nova-compute[75826]:   <vcpu max='255'/>
Nov 16 00:34:59 user nova-compute[75826]:   <iothreads supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:   <os supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='firmware'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>efi</value>
Nov 16 00:34:59 user nova-compute[75826]:     </enum>
Nov 16 00:34:59 user nova-compute[75826]:     <loader supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>rom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pflash</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='readonly'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>yes</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='secure'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>no</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </loader>
Nov 16 00:34:59 user nova-compute[75826]:   </os>
Nov 16 00:34:59 user nova-compute[75826]:   <cpu>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-passthrough' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='hostPassthroughMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>on</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='maximum' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='maximumMigratable'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>on</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>off</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='host-model' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <vendor>Intel</vendor>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ss'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='vmx'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='pcid'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='hypervisor'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arat'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='tsc_adjust'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='umip'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='md-clear'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='arch-capabilities'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='invtsc'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibpb'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='ibrs'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-stibp'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='amd-ssbd'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='rsba'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='require' name='pschange-mc-no'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='erms'/>
Nov 16 00:34:59 user nova-compute[75826]:       <feature policy='disable' name='xsaveopt'/>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:     <mode name='custom' supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>qemu64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>qemu32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>phenom</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>pentium</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>n270</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>kvm64</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>kvm32</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>coreduo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>core2duo</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>athlon</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Westmere-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Westmere</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Snowridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Skylake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>SandyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Penryn</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G5</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G4</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G3</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Opteron_G2</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Opteron_G1</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Nehalem</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>IvyBridge</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Icelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Haswell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Rome</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-Milan</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC-IBPB</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>EPYC</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Dhyana</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cooperlake</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>Conroe</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Cascadelake-Server</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-noTSX</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell-IBRS</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='no'>Broadwell</model>
Nov 16 00:34:59 user nova-compute[75826]:       <model usable='yes'>486</model>
Nov 16 00:34:59 user nova-compute[75826]:     </mode>
Nov 16 00:34:59 user nova-compute[75826]:   </cpu>
Nov 16 00:34:59 user nova-compute[75826]:   <memoryBacking supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:     <enum name='sourceType'>
Nov 16 00:34:59 user nova-compute[75826]:       <value>file</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>anonymous</value>
Nov 16 00:34:59 user nova-compute[75826]:       <value>memfd</value>
Nov 16 00:34:59 user nova-compute[75826]:     </enum>
Nov 16 00:34:59 user nova-compute[75826]:   </memoryBacking>
Nov 16 00:34:59 user nova-compute[75826]:   <devices>
Nov 16 00:34:59 user nova-compute[75826]:     <disk supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='diskDevice'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>disk</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cdrom</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>floppy</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>lun</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='bus'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>ide</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>fdc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sata</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </disk>
Nov 16 00:34:59 user nova-compute[75826]:     <graphics supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='type'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>sdl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vnc</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>spice</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egl-headless</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </graphics>
Nov 16 00:34:59 user nova-compute[75826]:     <video supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='modelType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>cirrus</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>vmvga</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>qxl</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>none</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>bochs</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>ramfb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </video>
Nov 16 00:34:59 user nova-compute[75826]:     <hostdev supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='mode'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>subsystem</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='startupPolicy'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>default</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>mandatory</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>requisite</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>optional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='subsysType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>usb</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>pci</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>scsi</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='capsType'/>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='pciBackend'/>
Nov 16 00:34:59 user nova-compute[75826]:     </hostdev>
Nov 16 00:34:59 user nova-compute[75826]:     <rng supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtio-non-transitional</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>random</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>egd</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>builtin</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </rng>
Nov 16 00:34:59 user nova-compute[75826]:     <filesystem supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='driverType'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>path</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>handle</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>virtiofs</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </filesystem>
Nov 16 00:34:59 user nova-compute[75826]:     <tpm supported='yes'>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='model'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-tis</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>tpm-crb</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:       <enum name='backendModel'>
Nov 16 00:34:59 user nova-compute[75826]:         <value>passthrough</value>
Nov 16 00:34:59 user nova-compute[75826]:         <value>emulator</value>
Nov 16 00:34:59 user nova-compute[75826]:       </enum>
Nov 16 00:34:59 user nova-compute[75826]:     </tpm>
Nov 16 00:34:59 user nova-compute[75826]:   </devices>
Nov 16 00:34:59 user nova-compute[75826]:   <features>
Nov 16 00:34:59 user nova-compute[75826]:     <gic supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:     <vmcoreinfo supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <genid supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backingStoreInput supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <backup supported='yes'/>
Nov 16 00:34:59 user nova-compute[75826]:     <sev supported='no'/>
Nov 16 00:34:59 user nova-compute[75826]:   </features>
Nov 16 00:34:59 user nova-compute[75826]: </domainCapabilities>
Nov 16 00:34:59 user nova-compute[75826]:  {{(pid=75826) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75826) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75826) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Checking secure boot support for host arch (x86_64) {{(pid=75826) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Checking secure boot support for host arch (x86_64) {{(pid=75826) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Checking secure boot support for host arch (x86_64) {{(pid=75826) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 16 00:34:59 user nova-compute[75826]: INFO nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Secure Boot support detected
Nov 16 00:34:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] cpu compare xml: <cpu match="exact">
Nov 16 00:34:59 user nova-compute[75826]:   <model>Nehalem</model>
Nov 16 00:34:59 user nova-compute[75826]: </cpu>
Nov 16 00:34:59 user nova-compute[75826]:  {{(pid=75826) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 16 00:34:59 user nova-compute[75826]: INFO nova.virt.node [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Generated node identity 015246d3-5250-41ea-8943-b837ba3f5938
Nov 16 00:34:59 user nova-compute[75826]: INFO nova.virt.node [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Wrote node identity 015246d3-5250-41ea-8943-b837ba3f5938 to /opt/stack/data/nova/compute_id
Nov 16 00:34:59 user nova-compute[75826]: WARNING nova.compute.manager [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Compute nodes ['015246d3-5250-41ea-8943-b837ba3f5938'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 16 00:35:00 user nova-compute[75826]: INFO nova.compute.manager [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 16 00:35:00 user nova-compute[75826]: WARNING nova.compute.manager [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 16 00:35:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:35:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:35:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:35:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:35:00 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:35:00 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:35:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Hypervisor/Node resource view: name=user free_ram=11002MB free_disk=26.332618713378906GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:35:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:35:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:35:00 user nova-compute[75826]: WARNING nova.compute.resource_tracker [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] No compute node record for user:015246d3-5250-41ea-8943-b837ba3f5938: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 015246d3-5250-41ea-8943-b837ba3f5938 could not be found.
Nov 16 00:35:00 user nova-compute[75826]: INFO nova.compute.resource_tracker [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Compute node record created for user:user with uuid: 015246d3-5250-41ea-8943-b837ba3f5938
Nov 16 00:35:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:35:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:35:00 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] [req-b095f8da-83f3-4146-88a8-06b0dd7f0fd4] Created resource provider record via placement API for resource provider with UUID 015246d3-5250-41ea-8943-b837ba3f5938 and name user.
Nov 16 00:35:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75826) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 16 00:35:00 user nova-compute[75826]: INFO nova.virt.libvirt.host [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] kernel doesn't support AMD SEV
Nov 16 00:35:00 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Updating inventory in ProviderTree for provider 015246d3-5250-41ea-8943-b837ba3f5938 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 00:35:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:35:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Libvirt baseline CPU <cpu>
Nov 16 00:35:00 user nova-compute[75826]:   <arch>x86_64</arch>
Nov 16 00:35:00 user nova-compute[75826]:   <model>Nehalem</model>
Nov 16 00:35:00 user nova-compute[75826]:   <vendor>Intel</vendor>
Nov 16 00:35:00 user nova-compute[75826]:   <topology sockets="6" cores="1" threads="1"/>
Nov 16 00:35:00 user nova-compute[75826]: </cpu>
Nov 16 00:35:00 user nova-compute[75826]:  {{(pid=75826) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 16 00:35:00 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Updated inventory for provider 015246d3-5250-41ea-8943-b837ba3f5938 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 16 00:35:00 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Updating resource provider 015246d3-5250-41ea-8943-b837ba3f5938 generation from 0 to 1 during operation: update_inventory {{(pid=75826) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 00:35:00 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Updating inventory in ProviderTree for provider 015246d3-5250-41ea-8943-b837ba3f5938 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 00:35:00 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Updating resource provider 015246d3-5250-41ea-8943-b837ba3f5938 generation from 1 to 2 during operation: update_traits {{(pid=75826) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 16 00:35:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:35:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:35:01 user nova-compute[75826]: DEBUG nova.service [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Creating RPC server for service compute {{(pid=75826) start /opt/stack/nova/nova/service.py:182}}
Nov 16 00:35:01 user nova-compute[75826]: DEBUG nova.service [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] Join ServiceGroup membership for this service compute {{(pid=75826) start /opt/stack/nova/nova/service.py:199}}
Nov 16 00:35:01 user nova-compute[75826]: DEBUG nova.servicegroup.drivers.db [None req-42420fcd-70c8-49f5-a24e-6616307f4986 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75826) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:35:56 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:35:56 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:35:56 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=10437MB free_disk=26.244152069091797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.148s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:35:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:36:52 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:36:52 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:36:52 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=10381MB free_disk=26.308780670166016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:36:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:36:53 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:36:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:36:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 00:36:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 00:36:53 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:36:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:36:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:36:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:36:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:36:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:37:52 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:37:53 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:37:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:37:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 00:37:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 00:37:53 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:37:54 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:37:54 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:37:54 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=10375MB free_disk=26.060916900634766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:37:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:37:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:38:52 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:38:53 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:38:54 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:38:54 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:38:54 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9670MB free_disk=26.08169174194336GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:38:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.180s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:38:55 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:38:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:38:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 00:38:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 00:38:55 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:38:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:38:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:38:57 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:39:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "ee7b37f1-ac3b-4257-b463-790b3d19770d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:02 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:39:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "13b9b8b9-6ab1-4a8a-853f-00769b543743" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:02 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:39:02 user nova-compute[75826]: INFO nova.compute.claims [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Claim successful on node user
Nov 16 00:39:02 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.289s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:39:03 user nova-compute[75826]: INFO nova.compute.claims [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Claim successful on node user
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:39:03 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.409s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:39:03 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Creating image(s)
Nov 16 00:39:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "/opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.006s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "/opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:39:03 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.policy [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2826fd168ac4b49bf5295da2b21219a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '68b3993c3a5c4fb386c82befaa7e0bf4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:39:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:39:04 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Creating image(s)
Nov 16 00:39:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "/opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "/opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "/opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG nova.policy [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8606321461c403cbec7f0a36e454bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c7fd936b74e109f83fc69060af216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e.part --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG nova.virt.images [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] 61385222-0f31-4bd2-a3f7-ab482e7050c4 was qcow2, converting to raw {{(pid=75826) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e.part /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e.converted {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:39:04 user nova-compute[75826]: INFO nova.compute.claims [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Claim successful on node user
Nov 16 00:39:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e.part /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e.converted" returned: 0 in 0.222s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e.converted --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.278s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:05 user nova-compute[75826]: INFO oslo.privsep.daemon [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp1ieoaoc7/privsep.sock']
Nov 16 00:39:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.988s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:05 user sudo[85086]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp1ieoaoc7/privsep.sock
Nov 16 00:39:05 user sudo[85086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 00:39:05 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:39:05 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:39:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:05 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:39:05 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:39:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:39:05 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:39:05 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:39:05 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:39:05 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:39:05 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Creating image(s)
Nov 16 00:39:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "/opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "/opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:05 user nova-compute[75826]: DEBUG nova.policy [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '055179a465cc4327b4ce68af5018608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0d81c4b6d0415681092d61ea35de51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:39:06 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Successfully created port: 378f1586-075a-47fc-8723-540896093fe4 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:06 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Successfully created port: 0640d9b5-cefd-4695-bfb3-52c78b9da7d5 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:06 user sudo[85086]: pam_unix(sudo:session): session closed for user root
Nov 16 00:39:06 user nova-compute[75826]: INFO oslo.privsep.daemon [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Spawned new privsep daemon via rootwrap
Nov 16 00:39:06 user nova-compute[75826]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 00:39:06 user nova-compute[75826]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 00:39:06 user nova-compute[75826]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 16 00:39:06 user nova-compute[75826]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85111
Nov 16 00:39:06 user nova-compute[75826]: WARNING oslo_privsep.priv_context [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] privsep daemon already running
Nov 16 00:39:06 user nova-compute[75826]: WARNING oslo_privsep.priv_context [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] privsep daemon already running
Nov 16 00:39:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.199s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.385s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.353s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.234s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk 1073741824" returned: 0 in 0.117s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.355s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.165s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.162s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk 1073741824" returned: 0 in 0.043s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.416s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Cannot resize image /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Ensure instance console log exists: /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.195s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk 1073741824" returned: 0 in 0.043s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Cannot resize image /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Ensure instance console log exists: /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:39:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Cannot resize image /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Ensure instance console log exists: /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Successfully created port: 95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Successfully updated port: 0640d9b5-cefd-4695-bfb3-52c78b9da7d5 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.compute.manager [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "refresh_cache-ee7b37f1-ac3b-4257-b463-790b3d19770d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquired lock "refresh_cache-ee7b37f1-ac3b-4257-b463-790b3d19770d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:39:08 user nova-compute[75826]: INFO nova.compute.claims [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Claim successful on node user
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.compute.manager [req-e963fb76-d4f7-4a3d-a25d-ab2bdbd82abd req-3048d6fd-2859-4cfb-965d-127fc6b2087a service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Received event network-changed-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.compute.manager [req-e963fb76-d4f7-4a3d-a25d-ab2bdbd82abd req-3048d6fd-2859-4cfb-965d-127fc6b2087a service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Refreshing instance network info cache due to event network-changed-0640d9b5-cefd-4695-bfb3-52c78b9da7d5. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e963fb76-d4f7-4a3d-a25d-ab2bdbd82abd req-3048d6fd-2859-4cfb-965d-127fc6b2087a service nova] Acquiring lock "refresh_cache-ee7b37f1-ac3b-4257-b463-790b3d19770d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.331s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.compute.manager [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.compute.manager [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.network.neutron [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:39:08 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.compute.manager [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:39:08 user nova-compute[75826]: DEBUG nova.policy [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '19886e0e1844467785425d17411f9656', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '150aa3cf14d44a658edb06ade47a2d10', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Updating instance_info_cache with network_info: [{"id": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "address": "fa:16:3e:8b:4f:c6", "network": {"id": "7559216a-146b-4292-b08c-8efd725fe35a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-657857206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b3993c3a5c4fb386c82befaa7e0bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0640d9b5-ce", "ovs_interfaceid": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Releasing lock "refresh_cache-ee7b37f1-ac3b-4257-b463-790b3d19770d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Instance network_info: |[{"id": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "address": "fa:16:3e:8b:4f:c6", "network": {"id": "7559216a-146b-4292-b08c-8efd725fe35a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-657857206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b3993c3a5c4fb386c82befaa7e0bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0640d9b5-ce", "ovs_interfaceid": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e963fb76-d4f7-4a3d-a25d-ab2bdbd82abd req-3048d6fd-2859-4cfb-965d-127fc6b2087a service nova] Acquired lock "refresh_cache-ee7b37f1-ac3b-4257-b463-790b3d19770d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.network.neutron [req-e963fb76-d4f7-4a3d-a25d-ab2bdbd82abd req-3048d6fd-2859-4cfb-965d-127fc6b2087a service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Refreshing network info cache for port 0640d9b5-cefd-4695-bfb3-52c78b9da7d5 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Start _get_guest_xml network_info=[{"id": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "address": "fa:16:3e:8b:4f:c6", "network": {"id": "7559216a-146b-4292-b08c-8efd725fe35a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-657857206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b3993c3a5c4fb386c82befaa7e0bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0640d9b5-ce", "ovs_interfaceid": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:39:09 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Creating image(s)
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "/opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "/opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "/opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:09 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:09 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1790925052',display_name='tempest-DeleteServersTestJSON-server-1790925052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1790925052',id=1,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68b3993c3a5c4fb386c82befaa7e0bf4',ramdisk_id='',reservation_id='r-7624q1ye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-658187176',owner_user_name='tempest-DeleteServersTestJSON-658187176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:04Z,user_data=None,user_id='c2826fd168ac4b49bf5295da2b21219a',uuid=ee7b37f1-ac3b-4257-b463-790b3d19770d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "address": "fa:16:3e:8b:4f:c6", "network": {"id": "7559216a-146b-4292-b08c-8efd725fe35a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-657857206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b3993c3a5c4fb386c82befaa7e0bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0640d9b5-ce", "ovs_interfaceid": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Converting VIF {"id": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "address": "fa:16:3e:8b:4f:c6", "network": {"id": "7559216a-146b-4292-b08c-8efd725fe35a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-657857206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b3993c3a5c4fb386c82befaa7e0bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0640d9b5-ce", "ovs_interfaceid": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:4f:c6,bridge_name='br-int',has_traffic_filtering=True,id=0640d9b5-cefd-4695-bfb3-52c78b9da7d5,network=Network(7559216a-146b-4292-b08c-8efd725fe35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0640d9b5-ce') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.objects.instance [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lazy-loading 'pci_devices' on Instance uuid ee7b37f1-ac3b-4257-b463-790b3d19770d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:39:09 user nova-compute[75826]:   <uuid>ee7b37f1-ac3b-4257-b463-790b3d19770d</uuid>
Nov 16 00:39:09 user nova-compute[75826]:   <name>instance-00000001</name>
Nov 16 00:39:09 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:39:09 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:39:09 user nova-compute[75826]:   <metadata>
Nov 16 00:39:09 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:39:09 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:39:09 user nova-compute[75826]:       <nova:name>tempest-DeleteServersTestJSON-server-1790925052</nova:name>
Nov 16 00:39:09 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:39:09</nova:creationTime>
Nov 16 00:39:09 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:39:09 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:39:09 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:39:09 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:39:09 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:39:09 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:39:09 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:39:09 user nova-compute[75826]:       <nova:owner>
Nov 16 00:39:09 user nova-compute[75826]:         <nova:user uuid="c2826fd168ac4b49bf5295da2b21219a">tempest-DeleteServersTestJSON-658187176-project-member</nova:user>
Nov 16 00:39:09 user nova-compute[75826]:         <nova:project uuid="68b3993c3a5c4fb386c82befaa7e0bf4">tempest-DeleteServersTestJSON-658187176</nova:project>
Nov 16 00:39:09 user nova-compute[75826]:       </nova:owner>
Nov 16 00:39:09 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:39:09 user nova-compute[75826]:       <nova:ports>
Nov 16 00:39:09 user nova-compute[75826]:         <nova:port uuid="0640d9b5-cefd-4695-bfb3-52c78b9da7d5">
Nov 16 00:39:09 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 00:39:09 user nova-compute[75826]:         </nova:port>
Nov 16 00:39:09 user nova-compute[75826]:       </nova:ports>
Nov 16 00:39:09 user nova-compute[75826]:     </nova:instance>
Nov 16 00:39:09 user nova-compute[75826]:   </metadata>
Nov 16 00:39:09 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:39:09 user nova-compute[75826]:     <system>
Nov 16 00:39:09 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:39:09 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:39:09 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:39:09 user nova-compute[75826]:       <entry name="serial">ee7b37f1-ac3b-4257-b463-790b3d19770d</entry>
Nov 16 00:39:09 user nova-compute[75826]:       <entry name="uuid">ee7b37f1-ac3b-4257-b463-790b3d19770d</entry>
Nov 16 00:39:09 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:39:09 user nova-compute[75826]:     </system>
Nov 16 00:39:09 user nova-compute[75826]:   </sysinfo>
Nov 16 00:39:09 user nova-compute[75826]:   <os>
Nov 16 00:39:09 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:39:09 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:39:09 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:39:09 user nova-compute[75826]:   </os>
Nov 16 00:39:09 user nova-compute[75826]:   <features>
Nov 16 00:39:09 user nova-compute[75826]:     <acpi/>
Nov 16 00:39:09 user nova-compute[75826]:     <apic/>
Nov 16 00:39:09 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:39:09 user nova-compute[75826]:   </features>
Nov 16 00:39:09 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:39:09 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:39:09 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:39:09 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:39:09 user nova-compute[75826]:   </clock>
Nov 16 00:39:09 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:39:09 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:39:09 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:39:09 user nova-compute[75826]:   </cpu>
Nov 16 00:39:09 user nova-compute[75826]:   <devices>
Nov 16 00:39:09 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:39:09 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:39:09 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk"/>
Nov 16 00:39:09 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:39:09 user nova-compute[75826]:     </disk>
Nov 16 00:39:09 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:39:09 user nova-compute[75826]:       <mac address="fa:16:3e:8b:4f:c6"/>
Nov 16 00:39:09 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:09 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:39:09 user nova-compute[75826]:       <target dev="tap0640d9b5-ce"/>
Nov 16 00:39:09 user nova-compute[75826]:     </interface>
Nov 16 00:39:09 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:39:09 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/console.log" append="off"/>
Nov 16 00:39:09 user nova-compute[75826]:     </serial>
Nov 16 00:39:09 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:39:09 user nova-compute[75826]:     <video>
Nov 16 00:39:09 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:09 user nova-compute[75826]:     </video>
Nov 16 00:39:09 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:39:09 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:39:09 user nova-compute[75826]:     </rng>
Nov 16 00:39:09 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:39:09 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:39:09 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:39:09 user nova-compute[75826]:     </memballoon>
Nov 16 00:39:09 user nova-compute[75826]:   </devices>
Nov 16 00:39:09 user nova-compute[75826]: </domain>
Nov 16 00:39:09 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1790925052',display_name='tempest-DeleteServersTestJSON-server-1790925052',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1790925052',id=1,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='68b3993c3a5c4fb386c82befaa7e0bf4',ramdisk_id='',reservation_id='r-7624q1ye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-658187176',owner_user_name='tempest-DeleteServersTestJSON-658187176-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:04Z,user_data=None,user_id='c2826fd168ac4b49bf5295da2b21219a',uuid=ee7b37f1-ac3b-4257-b463-790b3d19770d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "address": "fa:16:3e:8b:4f:c6", "network": {"id": "7559216a-146b-4292-b08c-8efd725fe35a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-657857206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b3993c3a5c4fb386c82befaa7e0bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0640d9b5-ce", "ovs_interfaceid": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Converting VIF {"id": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "address": "fa:16:3e:8b:4f:c6", "network": {"id": "7559216a-146b-4292-b08c-8efd725fe35a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-657857206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b3993c3a5c4fb386c82befaa7e0bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0640d9b5-ce", "ovs_interfaceid": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8b:4f:c6,bridge_name='br-int',has_traffic_filtering=True,id=0640d9b5-cefd-4695-bfb3-52c78b9da7d5,network=Network(7559216a-146b-4292-b08c-8efd725fe35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0640d9b5-ce') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG os_vif [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:4f:c6,bridge_name='br-int',has_traffic_filtering=True,id=0640d9b5-cefd-4695-bfb3-52c78b9da7d5,network=Network(7559216a-146b-4292-b08c-8efd725fe35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0640d9b5-ce') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Created schema index Interface.name {{(pid=75826) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Created schema index Port.name {{(pid=75826) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Created schema index Bridge.name {{(pid=75826) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [POLLOUT] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Successfully updated port: 378f1586-075a-47fc-8723-540896093fe4 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.234s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquired lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81fb6ecc-bbe8-5cd5-82cd-1b4ff3425d25', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.302s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:09 user nova-compute[75826]: INFO oslo.privsep.daemon [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp1heky06a/privsep.sock']
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk 1073741824" returned: 0 in 0.043s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.349s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:09 user sudo[85194]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp1heky06a/privsep.sock
Nov 16 00:39:09 user sudo[85194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e4f0462-d3e1-457e-9792-d0d7a471fa1f req-8b47b5da-bd7b-495a-8530-3009c2e53ae0 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Received event network-changed-378f1586-075a-47fc-8723-540896093fe4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e4f0462-d3e1-457e-9792-d0d7a471fa1f req-8b47b5da-bd7b-495a-8530-3009c2e53ae0 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Refreshing instance network info cache due to event network-changed-378f1586-075a-47fc-8723-540896093fe4. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e4f0462-d3e1-457e-9792-d0d7a471fa1f req-8b47b5da-bd7b-495a-8530-3009c2e53ae0 service nova] Acquiring lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.154s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Cannot resize image /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Ensure instance console log exists: /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-e963fb76-d4f7-4a3d-a25d-ab2bdbd82abd req-3048d6fd-2859-4cfb-965d-127fc6b2087a service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Updated VIF entry in instance network info cache for port 0640d9b5-cefd-4695-bfb3-52c78b9da7d5. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-e963fb76-d4f7-4a3d-a25d-ab2bdbd82abd req-3048d6fd-2859-4cfb-965d-127fc6b2087a service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Updating instance_info_cache with network_info: [{"id": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "address": "fa:16:3e:8b:4f:c6", "network": {"id": "7559216a-146b-4292-b08c-8efd725fe35a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-657857206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b3993c3a5c4fb386c82befaa7e0bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0640d9b5-ce", "ovs_interfaceid": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e963fb76-d4f7-4a3d-a25d-ab2bdbd82abd req-3048d6fd-2859-4cfb-965d-127fc6b2087a service nova] Releasing lock "refresh_cache-ee7b37f1-ac3b-4257-b463-790b3d19770d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Successfully updated port: 95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquired lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Updating instance_info_cache with network_info: [{"id": "378f1586-075a-47fc-8723-540896093fe4", "address": "fa:16:3e:7d:d3:79", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378f1586-07", "ovs_interfaceid": "378f1586-075a-47fc-8723-540896093fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Releasing lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Instance network_info: |[{"id": "378f1586-075a-47fc-8723-540896093fe4", "address": "fa:16:3e:7d:d3:79", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378f1586-07", "ovs_interfaceid": "378f1586-075a-47fc-8723-540896093fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e4f0462-d3e1-457e-9792-d0d7a471fa1f req-8b47b5da-bd7b-495a-8530-3009c2e53ae0 service nova] Acquired lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-9e4f0462-d3e1-457e-9792-d0d7a471fa1f req-8b47b5da-bd7b-495a-8530-3009c2e53ae0 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Refreshing network info cache for port 378f1586-075a-47fc-8723-540896093fe4 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Start _get_guest_xml network_info=[{"id": "378f1586-075a-47fc-8723-540896093fe4", "address": "fa:16:3e:7d:d3:79", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378f1586-07", "ovs_interfaceid": "378f1586-075a-47fc-8723-540896093fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.network.neutron [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Successfully created port: 7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:10 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:10 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1519462314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1519462314',id=2,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-0l54ewg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:04Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=13b9b8b9-6ab1-4a8a-853f-00769b543743,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "378f1586-075a-47fc-8723-540896093fe4", "address": "fa:16:3e:7d:d3:79", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378f1586-07", "ovs_interfaceid": "378f1586-075a-47fc-8723-540896093fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "378f1586-075a-47fc-8723-540896093fe4", "address": "fa:16:3e:7d:d3:79", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378f1586-07", "ovs_interfaceid": "378f1586-075a-47fc-8723-540896093fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d3:79,bridge_name='br-int',has_traffic_filtering=True,id=378f1586-075a-47fc-8723-540896093fe4,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378f1586-07') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'pci_devices' on Instance uuid 13b9b8b9-6ab1-4a8a-853f-00769b543743 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:39:10 user nova-compute[75826]:   <uuid>13b9b8b9-6ab1-4a8a-853f-00769b543743</uuid>
Nov 16 00:39:10 user nova-compute[75826]:   <name>instance-00000002</name>
Nov 16 00:39:10 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:39:10 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:39:10 user nova-compute[75826]:   <metadata>
Nov 16 00:39:10 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:39:10 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:39:10 user nova-compute[75826]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1519462314</nova:name>
Nov 16 00:39:10 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:39:10</nova:creationTime>
Nov 16 00:39:10 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:39:10 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:39:10 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:39:10 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:39:10 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:39:10 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:39:10 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:39:10 user nova-compute[75826]:       <nova:owner>
Nov 16 00:39:10 user nova-compute[75826]:         <nova:user uuid="f8606321461c403cbec7f0a36e454bc8">tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member</nova:user>
Nov 16 00:39:10 user nova-compute[75826]:         <nova:project uuid="e45c7fd936b74e109f83fc69060af216">tempest-ServerBootFromVolumeStableRescueTest-1116494461</nova:project>
Nov 16 00:39:10 user nova-compute[75826]:       </nova:owner>
Nov 16 00:39:10 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:39:10 user nova-compute[75826]:       <nova:ports>
Nov 16 00:39:10 user nova-compute[75826]:         <nova:port uuid="378f1586-075a-47fc-8723-540896093fe4">
Nov 16 00:39:10 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 00:39:10 user nova-compute[75826]:         </nova:port>
Nov 16 00:39:10 user nova-compute[75826]:       </nova:ports>
Nov 16 00:39:10 user nova-compute[75826]:     </nova:instance>
Nov 16 00:39:10 user nova-compute[75826]:   </metadata>
Nov 16 00:39:10 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:39:10 user nova-compute[75826]:     <system>
Nov 16 00:39:10 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:39:10 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:39:10 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:39:10 user nova-compute[75826]:       <entry name="serial">13b9b8b9-6ab1-4a8a-853f-00769b543743</entry>
Nov 16 00:39:10 user nova-compute[75826]:       <entry name="uuid">13b9b8b9-6ab1-4a8a-853f-00769b543743</entry>
Nov 16 00:39:10 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:39:10 user nova-compute[75826]:     </system>
Nov 16 00:39:10 user nova-compute[75826]:   </sysinfo>
Nov 16 00:39:10 user nova-compute[75826]:   <os>
Nov 16 00:39:10 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:39:10 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:39:10 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:39:10 user nova-compute[75826]:   </os>
Nov 16 00:39:10 user nova-compute[75826]:   <features>
Nov 16 00:39:10 user nova-compute[75826]:     <acpi/>
Nov 16 00:39:10 user nova-compute[75826]:     <apic/>
Nov 16 00:39:10 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:39:10 user nova-compute[75826]:   </features>
Nov 16 00:39:10 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:39:10 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:39:10 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:39:10 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:39:10 user nova-compute[75826]:   </clock>
Nov 16 00:39:10 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:39:10 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:39:10 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:39:10 user nova-compute[75826]:   </cpu>
Nov 16 00:39:10 user nova-compute[75826]:   <devices>
Nov 16 00:39:10 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:39:10 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:39:10 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk"/>
Nov 16 00:39:10 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:39:10 user nova-compute[75826]:     </disk>
Nov 16 00:39:10 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:39:10 user nova-compute[75826]:       <mac address="fa:16:3e:7d:d3:79"/>
Nov 16 00:39:10 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:10 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:39:10 user nova-compute[75826]:       <target dev="tap378f1586-07"/>
Nov 16 00:39:10 user nova-compute[75826]:     </interface>
Nov 16 00:39:10 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:39:10 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/console.log" append="off"/>
Nov 16 00:39:10 user nova-compute[75826]:     </serial>
Nov 16 00:39:10 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:39:10 user nova-compute[75826]:     <video>
Nov 16 00:39:10 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:10 user nova-compute[75826]:     </video>
Nov 16 00:39:10 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:39:10 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:39:10 user nova-compute[75826]:     </rng>
Nov 16 00:39:10 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:39:10 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:39:10 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:39:10 user nova-compute[75826]:     </memballoon>
Nov 16 00:39:10 user nova-compute[75826]:   </devices>
Nov 16 00:39:10 user nova-compute[75826]: </domain>
Nov 16 00:39:10 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1519462314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1519462314',id=2,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-0l54ewg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:04Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=13b9b8b9-6ab1-4a8a-853f-00769b543743,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "378f1586-075a-47fc-8723-540896093fe4", "address": "fa:16:3e:7d:d3:79", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378f1586-07", "ovs_interfaceid": "378f1586-075a-47fc-8723-540896093fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "378f1586-075a-47fc-8723-540896093fe4", "address": "fa:16:3e:7d:d3:79", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378f1586-07", "ovs_interfaceid": "378f1586-075a-47fc-8723-540896093fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d3:79,bridge_name='br-int',has_traffic_filtering=True,id=378f1586-075a-47fc-8723-540896093fe4,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378f1586-07') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG os_vif [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d3:79,bridge_name='br-int',has_traffic_filtering=True,id=378f1586-075a-47fc-8723-540896093fe4,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378f1586-07') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c259a5d7-712f-5dce-beb6-56bd6d7307b6', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:39:11 user sudo[85194]: pam_unix(sudo:session): session closed for user root
Nov 16 00:39:11 user nova-compute[75826]: INFO oslo.privsep.daemon [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Spawned new privsep daemon via rootwrap
Nov 16 00:39:11 user nova-compute[75826]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 00:39:11 user nova-compute[75826]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 00:39:11 user nova-compute[75826]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 16 00:39:11 user nova-compute[75826]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85204
Nov 16 00:39:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-c1629a0a-2080-4963-a8db-9f1bd977c7c0 req-f369ace7-49ff-4838-8cc9-099570cbf734 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Received event network-changed-95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-c1629a0a-2080-4963-a8db-9f1bd977c7c0 req-f369ace7-49ff-4838-8cc9-099570cbf734 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Refreshing instance network info cache due to event network-changed-95244a55-3c22-4eb7-ada5-7c20002f8728. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c1629a0a-2080-4963-a8db-9f1bd977c7c0 req-f369ace7-49ff-4838-8cc9-099570cbf734 service nova] Acquiring lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:11 user nova-compute[75826]: WARNING oslo_privsep.priv_context [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] privsep daemon already running
Nov 16 00:39:11 user nova-compute[75826]: DEBUG nova.network.neutron [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Successfully updated port: 7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquired lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG nova.network.neutron [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-464df397-0805-4fa6-a33e-a859c40bc367 req-4d6a81b8-7592-4a79-8683-a4a642970c87 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-changed-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-464df397-0805-4fa6-a33e-a859c40bc367 req-4d6a81b8-7592-4a79-8683-a4a642970c87 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Refreshing instance network info cache due to event network-changed-7cb43f66-87cf-4cac-85ab-abfe01ff82cc. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-464df397-0805-4fa6-a33e-a859c40bc367 req-4d6a81b8-7592-4a79-8683-a4a642970c87 service nova] Acquiring lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap378f1586-07, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap378f1586-07, col_values=(('qos', UUID('430146ad-d529-4a78-8d03-959adbaece7b')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap378f1586-07, col_values=(('external_ids', {'iface-id': '378f1586-075a-47fc-8723-540896093fe4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:d3:79', 'vm-uuid': '13b9b8b9-6ab1-4a8a-853f-00769b543743'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG nova.network.neutron [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:11 user nova-compute[75826]: INFO os_vif [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:d3:79,bridge_name='br-int',has_traffic_filtering=True,id=378f1586-075a-47fc-8723-540896093fe4,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378f1586-07')
Nov 16 00:39:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0640d9b5-ce, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0640d9b5-ce, col_values=(('qos', UUID('aa446bd6-cfec-466a-95c8-b210a72fd05b')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0640d9b5-ce, col_values=(('external_ids', {'iface-id': '0640d9b5-cefd-4695-bfb3-52c78b9da7d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8b:4f:c6', 'vm-uuid': 'ee7b37f1-ac3b-4257-b463-790b3d19770d'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:11 user nova-compute[75826]: INFO os_vif [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8b:4f:c6,bridge_name='br-int',has_traffic_filtering=True,id=0640d9b5-cefd-4695-bfb3-52c78b9da7d5,network=Network(7559216a-146b-4292-b08c-8efd725fe35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0640d9b5-ce')
Nov 16 00:39:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No VIF found with MAC fa:16:3e:7d:d3:79, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] No VIF found with MAC fa:16:3e:8b:4f:c6, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:39:11 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updating instance_info_cache with network_info: [{"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Releasing lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Instance network_info: |[{"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c1629a0a-2080-4963-a8db-9f1bd977c7c0 req-f369ace7-49ff-4838-8cc9-099570cbf734 service nova] Acquired lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.network.neutron [req-c1629a0a-2080-4963-a8db-9f1bd977c7c0 req-f369ace7-49ff-4838-8cc9-099570cbf734 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Refreshing network info cache for port 95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Start _get_guest_xml network_info=[{"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:39:12 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:12 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1012088855',display_name='tempest-ServerActionsTestOtherA-server-1012088855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1012088855',id=3,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcHp4MQ1nmnfoZHtG9WUM26rOqXSqM447yKb3OZbHurSNdmdHJlgSIOlTsu4HAYreZ++oluuNxFq/KteFOdGXtyepeTckkePgfQai5TpDlxusLQNPtiszvnX3ROIIcIMw==',key_name='tempest-keypair-2013094512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-xd6m7q91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:3e:e0,bridge_name='br-int',has_traffic_filtering=True,id=95244a55-3c22-4eb7-ada5-7c20002f8728,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95244a55-3c') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.objects.instance [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lazy-loading 'pci_devices' on Instance uuid ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:39:12 user nova-compute[75826]:   <uuid>ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62</uuid>
Nov 16 00:39:12 user nova-compute[75826]:   <name>instance-00000003</name>
Nov 16 00:39:12 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:39:12 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:39:12 user nova-compute[75826]:   <metadata>
Nov 16 00:39:12 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:39:12 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:39:12 user nova-compute[75826]:       <nova:name>tempest-ServerActionsTestOtherA-server-1012088855</nova:name>
Nov 16 00:39:12 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:39:12</nova:creationTime>
Nov 16 00:39:12 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:39:12 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:39:12 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:39:12 user nova-compute[75826]:       <nova:owner>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:user uuid="055179a465cc4327b4ce68af5018608c">tempest-ServerActionsTestOtherA-329506797-project-member</nova:user>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:project uuid="4d0d81c4b6d0415681092d61ea35de51">tempest-ServerActionsTestOtherA-329506797</nova:project>
Nov 16 00:39:12 user nova-compute[75826]:       </nova:owner>
Nov 16 00:39:12 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:39:12 user nova-compute[75826]:       <nova:ports>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:port uuid="95244a55-3c22-4eb7-ada5-7c20002f8728">
Nov 16 00:39:12 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 00:39:12 user nova-compute[75826]:         </nova:port>
Nov 16 00:39:12 user nova-compute[75826]:       </nova:ports>
Nov 16 00:39:12 user nova-compute[75826]:     </nova:instance>
Nov 16 00:39:12 user nova-compute[75826]:   </metadata>
Nov 16 00:39:12 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:39:12 user nova-compute[75826]:     <system>
Nov 16 00:39:12 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:39:12 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:39:12 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:39:12 user nova-compute[75826]:       <entry name="serial">ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62</entry>
Nov 16 00:39:12 user nova-compute[75826]:       <entry name="uuid">ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62</entry>
Nov 16 00:39:12 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:39:12 user nova-compute[75826]:     </system>
Nov 16 00:39:12 user nova-compute[75826]:   </sysinfo>
Nov 16 00:39:12 user nova-compute[75826]:   <os>
Nov 16 00:39:12 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:39:12 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:39:12 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:39:12 user nova-compute[75826]:   </os>
Nov 16 00:39:12 user nova-compute[75826]:   <features>
Nov 16 00:39:12 user nova-compute[75826]:     <acpi/>
Nov 16 00:39:12 user nova-compute[75826]:     <apic/>
Nov 16 00:39:12 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:39:12 user nova-compute[75826]:   </features>
Nov 16 00:39:12 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:39:12 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:39:12 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:39:12 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:39:12 user nova-compute[75826]:   </clock>
Nov 16 00:39:12 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:39:12 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:39:12 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:39:12 user nova-compute[75826]:   </cpu>
Nov 16 00:39:12 user nova-compute[75826]:   <devices>
Nov 16 00:39:12 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:39:12 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:39:12 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk"/>
Nov 16 00:39:12 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:39:12 user nova-compute[75826]:     </disk>
Nov 16 00:39:12 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:39:12 user nova-compute[75826]:       <mac address="fa:16:3e:20:3e:e0"/>
Nov 16 00:39:12 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:12 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:39:12 user nova-compute[75826]:       <target dev="tap95244a55-3c"/>
Nov 16 00:39:12 user nova-compute[75826]:     </interface>
Nov 16 00:39:12 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:39:12 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/console.log" append="off"/>
Nov 16 00:39:12 user nova-compute[75826]:     </serial>
Nov 16 00:39:12 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:39:12 user nova-compute[75826]:     <video>
Nov 16 00:39:12 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:12 user nova-compute[75826]:     </video>
Nov 16 00:39:12 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:39:12 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:39:12 user nova-compute[75826]:     </rng>
Nov 16 00:39:12 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:39:12 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:39:12 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:39:12 user nova-compute[75826]:     </memballoon>
Nov 16 00:39:12 user nova-compute[75826]:   </devices>
Nov 16 00:39:12 user nova-compute[75826]: </domain>
Nov 16 00:39:12 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1012088855',display_name='tempest-ServerActionsTestOtherA-server-1012088855',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1012088855',id=3,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcHp4MQ1nmnfoZHtG9WUM26rOqXSqM447yKb3OZbHurSNdmdHJlgSIOlTsu4HAYreZ++oluuNxFq/KteFOdGXtyepeTckkePgfQai5TpDlxusLQNPtiszvnX3ROIIcIMw==',key_name='tempest-keypair-2013094512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-xd6m7q91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:3e:e0,bridge_name='br-int',has_traffic_filtering=True,id=95244a55-3c22-4eb7-ada5-7c20002f8728,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95244a55-3c') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG os_vif [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:3e:e0,bridge_name='br-int',has_traffic_filtering=True,id=95244a55-3c22-4eb7-ada5-7c20002f8728,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95244a55-3c') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '876a3a24-37ee-54cf-8e29-7751e69dd85a', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95244a55-3c, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95244a55-3c, col_values=(('qos', UUID('2d7e1169-2d4b-4e28-a960-4d59329c6547')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95244a55-3c, col_values=(('external_ids', {'iface-id': '95244a55-3c22-4eb7-ada5-7c20002f8728', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:3e:e0', 'vm-uuid': 'ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: INFO os_vif [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:3e:e0,bridge_name='br-int',has_traffic_filtering=True,id=95244a55-3c22-4eb7-ada5-7c20002f8728,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95244a55-3c')
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No VIF found with MAC fa:16:3e:20:3e:e0, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.network.neutron [req-9e4f0462-d3e1-457e-9792-d0d7a471fa1f req-8b47b5da-bd7b-495a-8530-3009c2e53ae0 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Updated VIF entry in instance network info cache for port 378f1586-075a-47fc-8723-540896093fe4. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.network.neutron [req-9e4f0462-d3e1-457e-9792-d0d7a471fa1f req-8b47b5da-bd7b-495a-8530-3009c2e53ae0 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Updating instance_info_cache with network_info: [{"id": "378f1586-075a-47fc-8723-540896093fe4", "address": "fa:16:3e:7d:d3:79", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378f1586-07", "ovs_interfaceid": "378f1586-075a-47fc-8723-540896093fe4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e4f0462-d3e1-457e-9792-d0d7a471fa1f req-8b47b5da-bd7b-495a-8530-3009c2e53ae0 service nova] Releasing lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.network.neutron [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating instance_info_cache with network_info: [{"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Releasing lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.compute.manager [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Instance network_info: |[{"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-464df397-0805-4fa6-a33e-a859c40bc367 req-4d6a81b8-7592-4a79-8683-a4a642970c87 service nova] Acquired lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.network.neutron [req-464df397-0805-4fa6-a33e-a859c40bc367 req-4d6a81b8-7592-4a79-8683-a4a642970c87 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Refreshing network info cache for port 7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Start _get_guest_xml network_info=[{"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:39:12 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:12 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-128052432',display_name='tempest-ServerActionsTestOtherB-server-128052432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-128052432',id=4,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXVSxyrOOv945LMuSP1ZSY2bKy/r2ENoqaOk1WP30X55vRshqh2IlMTn2ZQNXytP2IoxEzIDq41/VjnE1Be/JLQH8UoBKnsMheiLtYOBuEJV23nUuMbFcWJ5C5rYTqIuQ==',key_name='tempest-keypair-103688613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='150aa3cf14d44a658edb06ade47a2d10',ramdisk_id='',reservation_id='r-tzkzh647',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1007762654',owner_user_name='tempest-ServerActionsTestOtherB-1007762654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19886e0e1844467785425d17411f9656',uuid=713e6618-89af-47e0-ba5a-4f77cb1d7ff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converting VIF {"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.objects.instance [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lazy-loading 'pci_devices' on Instance uuid 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:39:12 user nova-compute[75826]:   <uuid>713e6618-89af-47e0-ba5a-4f77cb1d7ff6</uuid>
Nov 16 00:39:12 user nova-compute[75826]:   <name>instance-00000004</name>
Nov 16 00:39:12 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:39:12 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:39:12 user nova-compute[75826]:   <metadata>
Nov 16 00:39:12 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:39:12 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:39:12 user nova-compute[75826]:       <nova:name>tempest-ServerActionsTestOtherB-server-128052432</nova:name>
Nov 16 00:39:12 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:39:12</nova:creationTime>
Nov 16 00:39:12 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:39:12 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:39:12 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:39:12 user nova-compute[75826]:       <nova:owner>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:user uuid="19886e0e1844467785425d17411f9656">tempest-ServerActionsTestOtherB-1007762654-project-member</nova:user>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:project uuid="150aa3cf14d44a658edb06ade47a2d10">tempest-ServerActionsTestOtherB-1007762654</nova:project>
Nov 16 00:39:12 user nova-compute[75826]:       </nova:owner>
Nov 16 00:39:12 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:39:12 user nova-compute[75826]:       <nova:ports>
Nov 16 00:39:12 user nova-compute[75826]:         <nova:port uuid="7cb43f66-87cf-4cac-85ab-abfe01ff82cc">
Nov 16 00:39:12 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 00:39:12 user nova-compute[75826]:         </nova:port>
Nov 16 00:39:12 user nova-compute[75826]:       </nova:ports>
Nov 16 00:39:12 user nova-compute[75826]:     </nova:instance>
Nov 16 00:39:12 user nova-compute[75826]:   </metadata>
Nov 16 00:39:12 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:39:12 user nova-compute[75826]:     <system>
Nov 16 00:39:12 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:39:12 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:39:12 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:39:12 user nova-compute[75826]:       <entry name="serial">713e6618-89af-47e0-ba5a-4f77cb1d7ff6</entry>
Nov 16 00:39:12 user nova-compute[75826]:       <entry name="uuid">713e6618-89af-47e0-ba5a-4f77cb1d7ff6</entry>
Nov 16 00:39:12 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:39:12 user nova-compute[75826]:     </system>
Nov 16 00:39:12 user nova-compute[75826]:   </sysinfo>
Nov 16 00:39:12 user nova-compute[75826]:   <os>
Nov 16 00:39:12 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:39:12 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:39:12 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:39:12 user nova-compute[75826]:   </os>
Nov 16 00:39:12 user nova-compute[75826]:   <features>
Nov 16 00:39:12 user nova-compute[75826]:     <acpi/>
Nov 16 00:39:12 user nova-compute[75826]:     <apic/>
Nov 16 00:39:12 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:39:12 user nova-compute[75826]:   </features>
Nov 16 00:39:12 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:39:12 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:39:12 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:39:12 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:39:12 user nova-compute[75826]:   </clock>
Nov 16 00:39:12 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:39:12 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:39:12 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:39:12 user nova-compute[75826]:   </cpu>
Nov 16 00:39:12 user nova-compute[75826]:   <devices>
Nov 16 00:39:12 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:39:12 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:39:12 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk"/>
Nov 16 00:39:12 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:39:12 user nova-compute[75826]:     </disk>
Nov 16 00:39:12 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:39:12 user nova-compute[75826]:       <mac address="fa:16:3e:be:0d:c1"/>
Nov 16 00:39:12 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:12 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:39:12 user nova-compute[75826]:       <target dev="tap7cb43f66-87"/>
Nov 16 00:39:12 user nova-compute[75826]:     </interface>
Nov 16 00:39:12 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:39:12 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/console.log" append="off"/>
Nov 16 00:39:12 user nova-compute[75826]:     </serial>
Nov 16 00:39:12 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:39:12 user nova-compute[75826]:     <video>
Nov 16 00:39:12 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:12 user nova-compute[75826]:     </video>
Nov 16 00:39:12 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:39:12 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:39:12 user nova-compute[75826]:     </rng>
Nov 16 00:39:12 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:39:12 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:39:12 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:39:12 user nova-compute[75826]:     </memballoon>
Nov 16 00:39:12 user nova-compute[75826]:   </devices>
Nov 16 00:39:12 user nova-compute[75826]: </domain>
Nov 16 00:39:12 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-128052432',display_name='tempest-ServerActionsTestOtherB-server-128052432',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-128052432',id=4,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXVSxyrOOv945LMuSP1ZSY2bKy/r2ENoqaOk1WP30X55vRshqh2IlMTn2ZQNXytP2IoxEzIDq41/VjnE1Be/JLQH8UoBKnsMheiLtYOBuEJV23nUuMbFcWJ5C5rYTqIuQ==',key_name='tempest-keypair-103688613',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='150aa3cf14d44a658edb06ade47a2d10',ramdisk_id='',reservation_id='r-tzkzh647',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1007762654',owner_user_name='tempest-ServerActionsTestOtherB-1007762654-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19886e0e1844467785425d17411f9656',uuid=713e6618-89af-47e0-ba5a-4f77cb1d7ff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converting VIF {"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG os_vif [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5a7e6b6-f748-50cf-90d8-48efb2e56403', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cb43f66-87, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cb43f66-87, col_values=(('qos', UUID('be8189e2-c676-4ed3-847e-73ece73d2268')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cb43f66-87, col_values=(('external_ids', {'iface-id': '7cb43f66-87cf-4cac-85ab-abfe01ff82cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:0d:c1', 'vm-uuid': '713e6618-89af-47e0-ba5a-4f77cb1d7ff6'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:12 user nova-compute[75826]: INFO os_vif [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87')
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] No VIF found with MAC fa:16:3e:be:0d:c1, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:39:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:13 user nova-compute[75826]: DEBUG nova.network.neutron [req-c1629a0a-2080-4963-a8db-9f1bd977c7c0 req-f369ace7-49ff-4838-8cc9-099570cbf734 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updated VIF entry in instance network info cache for port 95244a55-3c22-4eb7-ada5-7c20002f8728. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:39:13 user nova-compute[75826]: DEBUG nova.network.neutron [req-c1629a0a-2080-4963-a8db-9f1bd977c7c0 req-f369ace7-49ff-4838-8cc9-099570cbf734 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updating instance_info_cache with network_info: [{"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c1629a0a-2080-4963-a8db-9f1bd977c7c0 req-f369ace7-49ff-4838-8cc9-099570cbf734 service nova] Releasing lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:13 user nova-compute[75826]: DEBUG nova.network.neutron [req-464df397-0805-4fa6-a33e-a859c40bc367 req-4d6a81b8-7592-4a79-8683-a4a642970c87 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updated VIF entry in instance network info cache for port 7cb43f66-87cf-4cac-85ab-abfe01ff82cc. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:39:13 user nova-compute[75826]: DEBUG nova.network.neutron [req-464df397-0805-4fa6-a33e-a859c40bc367 req-4d6a81b8-7592-4a79-8683-a4a642970c87 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating instance_info_cache with network_info: [{"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-464df397-0805-4fa6-a33e-a859c40bc367 req-4d6a81b8-7592-4a79-8683-a4a642970c87 service nova] Releasing lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:39:19 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Instance spawned successfully.
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:19 user nova-compute[75826]: INFO nova.compute.manager [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Took 15.54 seconds to spawn the instance on the hypervisor.
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:39:19 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Instance spawned successfully.
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:20 user nova-compute[75826]: INFO nova.compute.manager [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Took 17.15 seconds to build instance.
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:39:20 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Instance spawned successfully.
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:39:20 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Instance spawned successfully.
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6890acb1-e2b7-44f1-947e-84003760ad30 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.823s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:20 user nova-compute[75826]: INFO nova.compute.manager [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Took 16.84 seconds to spawn the instance on the hypervisor.
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:20 user nova-compute[75826]: INFO nova.compute.manager [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Took 15.37 seconds to spawn the instance on the hypervisor.
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:39:20 user nova-compute[75826]: INFO nova.compute.manager [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Took 11.86 seconds to spawn the instance on the hypervisor.
Nov 16 00:39:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:39:20 user nova-compute[75826]: INFO nova.compute.manager [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Took 18.43 seconds to build instance.
Nov 16 00:39:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8dcce32-3073-47b9-b529-cce20f8fd878 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.736s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:21 user nova-compute[75826]: INFO nova.compute.manager [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Took 16.51 seconds to build instance.
Nov 16 00:39:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d9fd1ad-61ec-4710-b333-fe617707c2a2 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.746s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:21 user nova-compute[75826]: INFO nova.compute.manager [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Took 12.93 seconds to build instance.
Nov 16 00:39:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-017d81dc-d18a-4488-9829-280abe68b2ac tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.118s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "d9ac6719-80f7-490a-a51e-869b51118aa2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:24 user nova-compute[75826]: DEBUG nova.compute.manager [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:39:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:24 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:39:24 user nova-compute[75826]: INFO nova.compute.claims [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Claim successful on node user
Nov 16 00:39:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:25 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:39:25 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:39:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.853s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:39:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:39:25 user nova-compute[75826]: DEBUG nova.network.neutron [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:39:25 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:39:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Acquiring lock "e9c58516-5dba-49b0-b94d-119adbbe8529" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG nova.policy [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a021a407de284df491fe3dc7b0608403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6aa796a8fb4ea79988055543768456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:39:26 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Creating image(s)
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "/opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "/opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "/opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:39:26 user nova-compute[75826]: INFO nova.compute.claims [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Claim successful on node user
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.247s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.223s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk 1073741824" returned: 0 in 0.068s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.302s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.725s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Cannot resize image /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Ensure instance console log exists: /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:27 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.policy [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6a4fb21becf47aca4dd42739c9cffa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '950b8891b252440daf6ef1b3400b0f52', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:39:27 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Creating image(s)
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "/opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "/opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-bf0f03f8-8e35-4bd9-8641-81b55b5d27fc req-d7cc099b-3163-4319-bd70-00fe413bc33a service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Received event network-vif-plugged-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bf0f03f8-8e35-4bd9-8641-81b55b5d27fc req-d7cc099b-3163-4319-bd70-00fe413bc33a service nova] Acquiring lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bf0f03f8-8e35-4bd9-8641-81b55b5d27fc req-d7cc099b-3163-4319-bd70-00fe413bc33a service nova] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bf0f03f8-8e35-4bd9-8641-81b55b5d27fc req-d7cc099b-3163-4319-bd70-00fe413bc33a service nova] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-bf0f03f8-8e35-4bd9-8641-81b55b5d27fc req-d7cc099b-3163-4319-bd70-00fe413bc33a service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] No waiting events found dispatching network-vif-plugged-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:27 user nova-compute[75826]: WARNING nova.compute.manager [req-bf0f03f8-8e35-4bd9-8641-81b55b5d27fc req-d7cc099b-3163-4319-bd70-00fe413bc33a service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Received unexpected event network-vif-plugged-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 for instance with vm_state active and task_state None.
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.335s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.285s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk 1073741824" returned: 0 in 0.056s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.354s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG nova.network.neutron [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Successfully created port: e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.271s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Cannot resize image /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Ensure instance console log exists: /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-bdc313e6-c21c-4af3-ba3c-e9f250745ff4 req-9304fcd3-3b50-4c79-a19d-8af902b89b99 service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Received event network-vif-plugged-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bdc313e6-c21c-4af3-ba3c-e9f250745ff4 req-9304fcd3-3b50-4c79-a19d-8af902b89b99 service nova] Acquiring lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bdc313e6-c21c-4af3-ba3c-e9f250745ff4 req-9304fcd3-3b50-4c79-a19d-8af902b89b99 service nova] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bdc313e6-c21c-4af3-ba3c-e9f250745ff4 req-9304fcd3-3b50-4c79-a19d-8af902b89b99 service nova] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-bdc313e6-c21c-4af3-ba3c-e9f250745ff4 req-9304fcd3-3b50-4c79-a19d-8af902b89b99 service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] No waiting events found dispatching network-vif-plugged-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:29 user nova-compute[75826]: WARNING nova.compute.manager [req-bdc313e6-c21c-4af3-ba3c-e9f250745ff4 req-9304fcd3-3b50-4c79-a19d-8af902b89b99 service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Received unexpected event network-vif-plugged-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 for instance with vm_state active and task_state None.
Nov 16 00:39:30 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Successfully created port: ffeb91d2-58af-4045-9800-31518faad394 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "8946e093-6440-479f-95bc-c65391b9d2ba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "8946e093-6440-479f-95bc-c65391b9d2ba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:39:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:39:30 user nova-compute[75826]: INFO nova.compute.claims [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Claim successful on node user
Nov 16 00:39:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "33f2b149-1951-44d0-a65a-018316b31712" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "33f2b149-1951-44d0-a65a-018316b31712" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG nova.compute.manager [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG nova.network.neutron [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Successfully updated port: e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "refresh_cache-d9ac6719-80f7-490a-a51e-869b51118aa2" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquired lock "refresh_cache-d9ac6719-80f7-490a-a51e-869b51118aa2" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG nova.network.neutron [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-9f6db288-a485-4336-82c2-a5a9d1a6ccc8 req-fb3dd9e7-9904-4bca-ae8e-c79c839b81ce service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Received event network-changed-e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-9f6db288-a485-4336-82c2-a5a9d1a6ccc8 req-fb3dd9e7-9904-4bca-ae8e-c79c839b81ce service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Refreshing instance network info cache due to event network-changed-e7134fec-93d3-43b3-ba14-b08aa94c3cdf. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9f6db288-a485-4336-82c2-a5a9d1a6ccc8 req-fb3dd9e7-9904-4bca-ae8e-c79c839b81ce service nova] Acquiring lock "refresh_cache-d9ac6719-80f7-490a-a51e-869b51118aa2" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG nova.network.neutron [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.881s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG nova.compute.manager [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.190s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:39:31 user nova-compute[75826]: INFO nova.compute.claims [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Claim successful on node user
Nov 16 00:39:31 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Successfully updated port: ffeb91d2-58af-4045-9800-31518faad394 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG nova.compute.manager [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:39:31 user nova-compute[75826]: DEBUG nova.network.neutron [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Acquiring lock "refresh_cache-e9c58516-5dba-49b0-b94d-119adbbe8529" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Acquired lock "refresh_cache-e9c58516-5dba-49b0-b94d-119adbbe8529" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:39:32 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.compute.manager [req-07d0b499-a4fb-49d7-81f8-76666c7465a8 req-2c666040-318f-4fce-9b0d-1e09977909a1 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Received event network-changed-ffeb91d2-58af-4045-9800-31518faad394 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.compute.manager [req-07d0b499-a4fb-49d7-81f8-76666c7465a8 req-2c666040-318f-4fce-9b0d-1e09977909a1 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Refreshing instance network info cache due to event network-changed-ffeb91d2-58af-4045-9800-31518faad394. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-07d0b499-a4fb-49d7-81f8-76666c7465a8 req-2c666040-318f-4fce-9b0d-1e09977909a1 service nova] Acquiring lock "refresh_cache-e9c58516-5dba-49b0-b94d-119adbbe8529" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.policy [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd39be3e2d4ad4f8daec0c0927edfbd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571b03a1cf0e43c28d8ca716b737c558', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.compute.manager [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.network.neutron [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Updating instance_info_cache with network_info: [{"id": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "address": "fa:16:3e:03:9a:ea", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7134fec-93", "ovs_interfaceid": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Releasing lock "refresh_cache-d9ac6719-80f7-490a-a51e-869b51118aa2" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.compute.manager [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Instance network_info: |[{"id": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "address": "fa:16:3e:03:9a:ea", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7134fec-93", "ovs_interfaceid": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9f6db288-a485-4336-82c2-a5a9d1a6ccc8 req-fb3dd9e7-9904-4bca-ae8e-c79c839b81ce service nova] Acquired lock "refresh_cache-d9ac6719-80f7-490a-a51e-869b51118aa2" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.network.neutron [req-9f6db288-a485-4336-82c2-a5a9d1a6ccc8 req-fb3dd9e7-9904-4bca-ae8e-c79c839b81ce service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Refreshing network info cache for port e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Start _get_guest_xml network_info=[{"id": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "address": "fa:16:3e:03:9a:ea", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7134fec-93", "ovs_interfaceid": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:39:32 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:32 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-556892094',display_name='tempest-VolumesAdminNegativeTest-server-556892094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-556892094',id=5,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9QAaAFTexNEKF5fXTcOL7dNbLmlfaI/OmU9zv4oZhsP+jO/HWOkJKsG7s61B5qJxaZtjjsM9fvMNey6UI/Z/aAR7wugaM4nb8U+jn96M11eVubXv8gU5+dvUNteGxu4g==',key_name='tempest-keypair-1416900899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6aa796a8fb4ea79988055543768456',ramdisk_id='',reservation_id='r-5kud78aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1306204197',owner_user_name='tempest-VolumesAdminNegativeTest-1306204197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a021a407de284df491fe3dc7b0608403',uuid=d9ac6719-80f7-490a-a51e-869b51118aa2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "address": "fa:16:3e:03:9a:ea", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7134fec-93", "ovs_interfaceid": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Converting VIF {"id": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "address": "fa:16:3e:03:9a:ea", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7134fec-93", "ovs_interfaceid": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:9a:ea,bridge_name='br-int',has_traffic_filtering=True,id=e7134fec-93d3-43b3-ba14-b08aa94c3cdf,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7134fec-93') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.objects.instance [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lazy-loading 'pci_devices' on Instance uuid d9ac6719-80f7-490a-a51e-869b51118aa2 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:39:32 user nova-compute[75826]:   <uuid>d9ac6719-80f7-490a-a51e-869b51118aa2</uuid>
Nov 16 00:39:32 user nova-compute[75826]:   <name>instance-00000005</name>
Nov 16 00:39:32 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:39:32 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:39:32 user nova-compute[75826]:   <metadata>
Nov 16 00:39:32 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:39:32 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:39:32 user nova-compute[75826]:       <nova:name>tempest-VolumesAdminNegativeTest-server-556892094</nova:name>
Nov 16 00:39:32 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:39:32</nova:creationTime>
Nov 16 00:39:32 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:39:32 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:39:32 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:39:32 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:39:32 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:39:32 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:39:32 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:39:32 user nova-compute[75826]:       <nova:owner>
Nov 16 00:39:32 user nova-compute[75826]:         <nova:user uuid="a021a407de284df491fe3dc7b0608403">tempest-VolumesAdminNegativeTest-1306204197-project-member</nova:user>
Nov 16 00:39:32 user nova-compute[75826]:         <nova:project uuid="8f6aa796a8fb4ea79988055543768456">tempest-VolumesAdminNegativeTest-1306204197</nova:project>
Nov 16 00:39:32 user nova-compute[75826]:       </nova:owner>
Nov 16 00:39:32 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:39:32 user nova-compute[75826]:       <nova:ports>
Nov 16 00:39:32 user nova-compute[75826]:         <nova:port uuid="e7134fec-93d3-43b3-ba14-b08aa94c3cdf">
Nov 16 00:39:32 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:39:32 user nova-compute[75826]:         </nova:port>
Nov 16 00:39:32 user nova-compute[75826]:       </nova:ports>
Nov 16 00:39:32 user nova-compute[75826]:     </nova:instance>
Nov 16 00:39:32 user nova-compute[75826]:   </metadata>
Nov 16 00:39:32 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:39:32 user nova-compute[75826]:     <system>
Nov 16 00:39:32 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:39:32 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:39:32 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:39:32 user nova-compute[75826]:       <entry name="serial">d9ac6719-80f7-490a-a51e-869b51118aa2</entry>
Nov 16 00:39:32 user nova-compute[75826]:       <entry name="uuid">d9ac6719-80f7-490a-a51e-869b51118aa2</entry>
Nov 16 00:39:32 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:39:32 user nova-compute[75826]:     </system>
Nov 16 00:39:32 user nova-compute[75826]:   </sysinfo>
Nov 16 00:39:32 user nova-compute[75826]:   <os>
Nov 16 00:39:32 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:39:32 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:39:32 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:39:32 user nova-compute[75826]:   </os>
Nov 16 00:39:32 user nova-compute[75826]:   <features>
Nov 16 00:39:32 user nova-compute[75826]:     <acpi/>
Nov 16 00:39:32 user nova-compute[75826]:     <apic/>
Nov 16 00:39:32 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:39:32 user nova-compute[75826]:   </features>
Nov 16 00:39:32 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:39:32 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:39:32 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:39:32 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:39:32 user nova-compute[75826]:   </clock>
Nov 16 00:39:32 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:39:32 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:39:32 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:39:32 user nova-compute[75826]:   </cpu>
Nov 16 00:39:32 user nova-compute[75826]:   <devices>
Nov 16 00:39:32 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:39:32 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:39:32 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk"/>
Nov 16 00:39:32 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:39:32 user nova-compute[75826]:     </disk>
Nov 16 00:39:32 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:39:32 user nova-compute[75826]:       <mac address="fa:16:3e:03:9a:ea"/>
Nov 16 00:39:32 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:32 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:39:32 user nova-compute[75826]:       <target dev="tape7134fec-93"/>
Nov 16 00:39:32 user nova-compute[75826]:     </interface>
Nov 16 00:39:32 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:39:32 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/console.log" append="off"/>
Nov 16 00:39:32 user nova-compute[75826]:     </serial>
Nov 16 00:39:32 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:39:32 user nova-compute[75826]:     <video>
Nov 16 00:39:32 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:32 user nova-compute[75826]:     </video>
Nov 16 00:39:32 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:39:32 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:39:32 user nova-compute[75826]:     </rng>
Nov 16 00:39:32 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:39:32 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:39:32 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:39:32 user nova-compute[75826]:     </memballoon>
Nov 16 00:39:32 user nova-compute[75826]:   </devices>
Nov 16 00:39:32 user nova-compute[75826]: </domain>
Nov 16 00:39:32 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-556892094',display_name='tempest-VolumesAdminNegativeTest-server-556892094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-556892094',id=5,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9QAaAFTexNEKF5fXTcOL7dNbLmlfaI/OmU9zv4oZhsP+jO/HWOkJKsG7s61B5qJxaZtjjsM9fvMNey6UI/Z/aAR7wugaM4nb8U+jn96M11eVubXv8gU5+dvUNteGxu4g==',key_name='tempest-keypair-1416900899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6aa796a8fb4ea79988055543768456',ramdisk_id='',reservation_id='r-5kud78aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1306204197',owner_user_name='tempest-VolumesAdminNegativeTest-1306204197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a021a407de284df491fe3dc7b0608403',uuid=d9ac6719-80f7-490a-a51e-869b51118aa2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "address": "fa:16:3e:03:9a:ea", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7134fec-93", "ovs_interfaceid": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Converting VIF {"id": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "address": "fa:16:3e:03:9a:ea", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7134fec-93", "ovs_interfaceid": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:9a:ea,bridge_name='br-int',has_traffic_filtering=True,id=e7134fec-93d3-43b3-ba14-b08aa94c3cdf,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7134fec-93') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG os_vif [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:9a:ea,bridge_name='br-int',has_traffic_filtering=True,id=e7134fec-93d3-43b3-ba14-b08aa94c3cdf,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7134fec-93') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bd4e8181-9ac1-57db-ba29-0b4dfcaedb1f', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7134fec-93, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7134fec-93, col_values=(('qos', UUID('dcb210e5-3a5c-4c37-9aee-72783eb9276d')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7134fec-93, col_values=(('external_ids', {'iface-id': 'e7134fec-93d3-43b3-ba14-b08aa94c3cdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:9a:ea', 'vm-uuid': 'd9ac6719-80f7-490a-a51e-869b51118aa2'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:32 user nova-compute[75826]: INFO os_vif [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:9a:ea,bridge_name='br-int',has_traffic_filtering=True,id=e7134fec-93d3-43b3-ba14-b08aa94c3cdf,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7134fec-93')
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.compute.manager [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:39:32 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Creating image(s)
Nov 16 00:39:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "/opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "/opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "/opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "2ee06023589a2aa06ee408db6cde79be075deb9e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "2ee06023589a2aa06ee408db6cde79be075deb9e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] No VIF found with MAC fa:16:3e:03:9a:ea, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Updating instance_info_cache with network_info: [{"id": "ffeb91d2-58af-4045-9800-31518faad394", "address": "fa:16:3e:f5:c3:be", "network": {"id": "8d83dcd3-7c5e-4524-955d-0276d77888a6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-121467616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "950b8891b252440daf6ef1b3400b0f52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffeb91d2-58", "ovs_interfaceid": "ffeb91d2-58af-4045-9800-31518faad394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Releasing lock "refresh_cache-e9c58516-5dba-49b0-b94d-119adbbe8529" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Instance network_info: |[{"id": "ffeb91d2-58af-4045-9800-31518faad394", "address": "fa:16:3e:f5:c3:be", "network": {"id": "8d83dcd3-7c5e-4524-955d-0276d77888a6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-121467616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "950b8891b252440daf6ef1b3400b0f52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffeb91d2-58", "ovs_interfaceid": "ffeb91d2-58af-4045-9800-31518faad394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-07d0b499-a4fb-49d7-81f8-76666c7465a8 req-2c666040-318f-4fce-9b0d-1e09977909a1 service nova] Acquired lock "refresh_cache-e9c58516-5dba-49b0-b94d-119adbbe8529" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.network.neutron [req-07d0b499-a4fb-49d7-81f8-76666c7465a8 req-2c666040-318f-4fce-9b0d-1e09977909a1 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Refreshing network info cache for port ffeb91d2-58af-4045-9800-31518faad394 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Start _get_guest_xml network_info=[{"id": "ffeb91d2-58af-4045-9800-31518faad394", "address": "fa:16:3e:f5:c3:be", "network": {"id": "8d83dcd3-7c5e-4524-955d-0276d77888a6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-121467616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "950b8891b252440daf6ef1b3400b0f52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffeb91d2-58", "ovs_interfaceid": "ffeb91d2-58af-4045-9800-31518faad394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.860s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:32 user nova-compute[75826]: DEBUG nova.compute.manager [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e.part --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.compute.manager [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.network.neutron [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.004s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.network.neutron [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Successfully created port: 82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:33 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.compute.manager [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:39:33 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:33 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e.part --force-share --output=json" returned: 0 in 0.312s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.images [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] 54529057-c114-4810-8a21-ad42318af10c was qcow2, converting to raw {{(pid=75826) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e.part /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e.converted {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.compute.manager [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1626287548',display_name='tempest-VolumesActionsTest-instance-1626287548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1626287548',id=6,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='950b8891b252440daf6ef1b3400b0f52',ramdisk_id='',reservation_id='r-5k7p8zso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-890137240',owner_user_name='tempest-VolumesActionsTest-890137240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:27Z,user_data=None,user_id='a6a4fb21becf47aca4dd42739c9cffa1',uuid=e9c58516-5dba-49b0-b94d-119adbbe8529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffeb91d2-58af-4045-9800-31518faad394", "address": "fa:16:3e:f5:c3:be", "network": {"id": "8d83dcd3-7c5e-4524-955d-0276d77888a6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-121467616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "950b8891b252440daf6ef1b3400b0f52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffeb91d2-58", "ovs_interfaceid": "ffeb91d2-58af-4045-9800-31518faad394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Converting VIF {"id": "ffeb91d2-58af-4045-9800-31518faad394", "address": "fa:16:3e:f5:c3:be", "network": {"id": "8d83dcd3-7c5e-4524-955d-0276d77888a6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-121467616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "950b8891b252440daf6ef1b3400b0f52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffeb91d2-58", "ovs_interfaceid": "ffeb91d2-58af-4045-9800-31518faad394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=ffeb91d2-58af-4045-9800-31518faad394,network=Network(8d83dcd3-7c5e-4524-955d-0276d77888a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffeb91d2-58') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.objects.instance [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lazy-loading 'pci_devices' on Instance uuid e9c58516-5dba-49b0-b94d-119adbbe8529 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.policy [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd44daf19202c4460a56205d614f05118', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28d760459a430b9116e57172e64a77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e.part /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e.converted" returned: 0 in 0.293s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e.converted --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:33 user nova-compute[75826]: INFO nova.virt.block_device [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Booting with volume ef9dbcbd-3c51-40de-bfc8-4519b8543632 at /dev/vda
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:39:33 user nova-compute[75826]:   <uuid>e9c58516-5dba-49b0-b94d-119adbbe8529</uuid>
Nov 16 00:39:33 user nova-compute[75826]:   <name>instance-00000006</name>
Nov 16 00:39:33 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:39:33 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:39:33 user nova-compute[75826]:   <metadata>
Nov 16 00:39:33 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:39:33 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:39:33 user nova-compute[75826]:       <nova:name>tempest-VolumesActionsTest-instance-1626287548</nova:name>
Nov 16 00:39:33 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:39:33</nova:creationTime>
Nov 16 00:39:33 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:39:33 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:39:33 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:39:33 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:39:33 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:39:33 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:39:33 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:39:33 user nova-compute[75826]:       <nova:owner>
Nov 16 00:39:33 user nova-compute[75826]:         <nova:user uuid="a6a4fb21becf47aca4dd42739c9cffa1">tempest-VolumesActionsTest-890137240-project-member</nova:user>
Nov 16 00:39:33 user nova-compute[75826]:         <nova:project uuid="950b8891b252440daf6ef1b3400b0f52">tempest-VolumesActionsTest-890137240</nova:project>
Nov 16 00:39:33 user nova-compute[75826]:       </nova:owner>
Nov 16 00:39:33 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:39:33 user nova-compute[75826]:       <nova:ports>
Nov 16 00:39:33 user nova-compute[75826]:         <nova:port uuid="ffeb91d2-58af-4045-9800-31518faad394">
Nov 16 00:39:33 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 00:39:33 user nova-compute[75826]:         </nova:port>
Nov 16 00:39:33 user nova-compute[75826]:       </nova:ports>
Nov 16 00:39:33 user nova-compute[75826]:     </nova:instance>
Nov 16 00:39:33 user nova-compute[75826]:   </metadata>
Nov 16 00:39:33 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:39:33 user nova-compute[75826]:     <system>
Nov 16 00:39:33 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:39:33 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:39:33 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:39:33 user nova-compute[75826]:       <entry name="serial">e9c58516-5dba-49b0-b94d-119adbbe8529</entry>
Nov 16 00:39:33 user nova-compute[75826]:       <entry name="uuid">e9c58516-5dba-49b0-b94d-119adbbe8529</entry>
Nov 16 00:39:33 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:39:33 user nova-compute[75826]:     </system>
Nov 16 00:39:33 user nova-compute[75826]:   </sysinfo>
Nov 16 00:39:33 user nova-compute[75826]:   <os>
Nov 16 00:39:33 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:39:33 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:39:33 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:39:33 user nova-compute[75826]:   </os>
Nov 16 00:39:33 user nova-compute[75826]:   <features>
Nov 16 00:39:33 user nova-compute[75826]:     <acpi/>
Nov 16 00:39:33 user nova-compute[75826]:     <apic/>
Nov 16 00:39:33 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:39:33 user nova-compute[75826]:   </features>
Nov 16 00:39:33 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:39:33 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:39:33 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:39:33 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:39:33 user nova-compute[75826]:   </clock>
Nov 16 00:39:33 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:39:33 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:39:33 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:39:33 user nova-compute[75826]:   </cpu>
Nov 16 00:39:33 user nova-compute[75826]:   <devices>
Nov 16 00:39:33 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:39:33 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:39:33 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk"/>
Nov 16 00:39:33 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:39:33 user nova-compute[75826]:     </disk>
Nov 16 00:39:33 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:39:33 user nova-compute[75826]:       <mac address="fa:16:3e:f5:c3:be"/>
Nov 16 00:39:33 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:33 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:39:33 user nova-compute[75826]:       <target dev="tapffeb91d2-58"/>
Nov 16 00:39:33 user nova-compute[75826]:     </interface>
Nov 16 00:39:33 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:39:33 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/console.log" append="off"/>
Nov 16 00:39:33 user nova-compute[75826]:     </serial>
Nov 16 00:39:33 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:39:33 user nova-compute[75826]:     <video>
Nov 16 00:39:33 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:33 user nova-compute[75826]:     </video>
Nov 16 00:39:33 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:39:33 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:39:33 user nova-compute[75826]:     </rng>
Nov 16 00:39:33 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:39:33 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:39:33 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:39:33 user nova-compute[75826]:     </memballoon>
Nov 16 00:39:33 user nova-compute[75826]:   </devices>
Nov 16 00:39:33 user nova-compute[75826]: </domain>
Nov 16 00:39:33 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1626287548',display_name='tempest-VolumesActionsTest-instance-1626287548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1626287548',id=6,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='950b8891b252440daf6ef1b3400b0f52',ramdisk_id='',reservation_id='r-5k7p8zso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-890137240',owner_user_name='tempest-VolumesActionsTest-890137240-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:27Z,user_data=None,user_id='a6a4fb21becf47aca4dd42739c9cffa1',uuid=e9c58516-5dba-49b0-b94d-119adbbe8529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ffeb91d2-58af-4045-9800-31518faad394", "address": "fa:16:3e:f5:c3:be", "network": {"id": "8d83dcd3-7c5e-4524-955d-0276d77888a6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-121467616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "950b8891b252440daf6ef1b3400b0f52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffeb91d2-58", "ovs_interfaceid": "ffeb91d2-58af-4045-9800-31518faad394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Converting VIF {"id": "ffeb91d2-58af-4045-9800-31518faad394", "address": "fa:16:3e:f5:c3:be", "network": {"id": "8d83dcd3-7c5e-4524-955d-0276d77888a6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-121467616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "950b8891b252440daf6ef1b3400b0f52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffeb91d2-58", "ovs_interfaceid": "ffeb91d2-58af-4045-9800-31518faad394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=ffeb91d2-58af-4045-9800-31518faad394,network=Network(8d83dcd3-7c5e-4524-955d-0276d77888a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffeb91d2-58') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG os_vif [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=ffeb91d2-58af-4045-9800-31518faad394,network=Network(8d83dcd3-7c5e-4524-955d-0276d77888a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffeb91d2-58') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b461d29f-5e67-5d32-856c-06f9c22535f1', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:39:33 user nova-compute[75826]: INFO nova.compute.claims [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Claim successful on node user
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapffeb91d2-58, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapffeb91d2-58, col_values=(('qos', UUID('b0cd843b-623f-4ddc-a048-935cb068bc7a')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapffeb91d2-58, col_values=(('external_ids', {'iface-id': 'ffeb91d2-58af-4045-9800-31518faad394', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:c3:be', 'vm-uuid': 'e9c58516-5dba-49b0-b94d-119adbbe8529'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:33 user nova-compute[75826]: INFO os_vif [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=ffeb91d2-58af-4045-9800-31518faad394,network=Network(8d83dcd3-7c5e-4524-955d-0276d77888a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffeb91d2-58')
Nov 16 00:39:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] No VIF found with MAC fa:16:3e:f5:c3:be, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-33292341-f94e-4abf-b564-a8f89cdb8b71 req-1f0f53bd-640e-4ed9-ae0d-e08091bb55a5 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Received event network-vif-plugged-95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-33292341-f94e-4abf-b564-a8f89cdb8b71 req-1f0f53bd-640e-4ed9-ae0d-e08091bb55a5 service nova] Acquiring lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-33292341-f94e-4abf-b564-a8f89cdb8b71 req-1f0f53bd-640e-4ed9-ae0d-e08091bb55a5 service nova] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-33292341-f94e-4abf-b564-a8f89cdb8b71 req-1f0f53bd-640e-4ed9-ae0d-e08091bb55a5 service nova] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-33292341-f94e-4abf-b564-a8f89cdb8b71 req-1f0f53bd-640e-4ed9-ae0d-e08091bb55a5 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] No waiting events found dispatching network-vif-plugged-95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:34 user nova-compute[75826]: WARNING nova.compute.manager [req-33292341-f94e-4abf-b564-a8f89cdb8b71 req-1f0f53bd-640e-4ed9-ae0d-e08091bb55a5 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Received unexpected event network-vif-plugged-95244a55-3c22-4eb7-ada5-7c20002f8728 for instance with vm_state active and task_state None.
Nov 16 00:39:34 user nova-compute[75826]: DEBUG os_brick.utils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:39:34 user nova-compute[75826]: INFO oslo.privsep.daemon [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpr00wwlqh/privsep.sock']
Nov 16 00:39:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e.converted --force-share --output=json" returned: 0 in 0.353s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "2ee06023589a2aa06ee408db6cde79be075deb9e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.606s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:34 user sudo[85839]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpr00wwlqh/privsep.sock
Nov 16 00:39:34 user sudo[85839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 16 00:39:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e --force-share --output=json" returned: 0 in 0.252s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "2ee06023589a2aa06ee408db6cde79be075deb9e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "2ee06023589a2aa06ee408db6cde79be075deb9e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG nova.network.neutron [req-07d0b499-a4fb-49d7-81f8-76666c7465a8 req-2c666040-318f-4fce-9b0d-1e09977909a1 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Updated VIF entry in instance network info cache for port ffeb91d2-58af-4045-9800-31518faad394. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG nova.network.neutron [req-07d0b499-a4fb-49d7-81f8-76666c7465a8 req-2c666040-318f-4fce-9b0d-1e09977909a1 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Updating instance_info_cache with network_info: [{"id": "ffeb91d2-58af-4045-9800-31518faad394", "address": "fa:16:3e:f5:c3:be", "network": {"id": "8d83dcd3-7c5e-4524-955d-0276d77888a6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-121467616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "950b8891b252440daf6ef1b3400b0f52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffeb91d2-58", "ovs_interfaceid": "ffeb91d2-58af-4045-9800-31518faad394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-07d0b499-a4fb-49d7-81f8-76666c7465a8 req-2c666040-318f-4fce-9b0d-1e09977909a1 service nova] Releasing lock "refresh_cache-e9c58516-5dba-49b0-b94d-119adbbe8529" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e --force-share --output=json" returned: 0 in 0.350s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e,backing_fmt=raw /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e,backing_fmt=raw /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk 1073741824" returned: 0 in 0.163s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "2ee06023589a2aa06ee408db6cde79be075deb9e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.529s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.network.neutron [req-9f6db288-a485-4336-82c2-a5a9d1a6ccc8 req-fb3dd9e7-9904-4bca-ae8e-c79c839b81ce service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Updated VIF entry in instance network info cache for port e7134fec-93d3-43b3-ba14-b08aa94c3cdf. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.network.neutron [req-9f6db288-a485-4336-82c2-a5a9d1a6ccc8 req-fb3dd9e7-9904-4bca-ae8e-c79c839b81ce service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Updating instance_info_cache with network_info: [{"id": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "address": "fa:16:3e:03:9a:ea", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7134fec-93", "ovs_interfaceid": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9f6db288-a485-4336-82c2-a5a9d1a6ccc8 req-fb3dd9e7-9904-4bca-ae8e-c79c839b81ce service nova] Releasing lock "refresh_cache-d9ac6719-80f7-490a-a51e-869b51118aa2" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.network.neutron [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Successfully updated port: 82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e --force-share --output=json" returned: 0 in 0.475s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.720s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "refresh_cache-8946e093-6440-479f-95bc-c65391b9d2ba" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquired lock "refresh_cache-8946e093-6440-479f-95bc-c65391b9d2ba" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.network.neutron [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-a2ff2f48-4a98-4a47-8f6f-5877c349d2a4 req-95fa1f47-c3a2-4883-8a8f-fb7bd25efd15 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Received event network-changed-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-a2ff2f48-4a98-4a47-8f6f-5877c349d2a4 req-95fa1f47-c3a2-4883-8a8f-fb7bd25efd15 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Refreshing instance network info cache due to event network-changed-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a2ff2f48-4a98-4a47-8f6f-5877c349d2a4 req-95fa1f47-c3a2-4883-8a8f-fb7bd25efd15 service nova] Acquiring lock "refresh_cache-8946e093-6440-479f-95bc-c65391b9d2ba" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.network.neutron [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:39:35 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.network.neutron [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk --force-share --output=json" returned: 0 in 0.465s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Cannot resize image /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Ensure instance console log exists: /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.004s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.policy [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '159de45699cb47c68211051c7f62dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e313a75f9fc4e91b5866d0228336b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.compute.manager [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:39:36 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Creating image(s)
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-96d6060b-c58e-4f7f-8c46-f470a5de176d req-90972d1d-6f8f-4b6c-8cd2-99402774b362 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Received event network-vif-plugged-95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-96d6060b-c58e-4f7f-8c46-f470a5de176d req-90972d1d-6f8f-4b6c-8cd2-99402774b362 service nova] Acquiring lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-96d6060b-c58e-4f7f-8c46-f470a5de176d req-90972d1d-6f8f-4b6c-8cd2-99402774b362 service nova] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-96d6060b-c58e-4f7f-8c46-f470a5de176d req-90972d1d-6f8f-4b6c-8cd2-99402774b362 service nova] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-96d6060b-c58e-4f7f-8c46-f470a5de176d req-90972d1d-6f8f-4b6c-8cd2-99402774b362 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] No waiting events found dispatching network-vif-plugged-95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:36 user nova-compute[75826]: WARNING nova.compute.manager [req-96d6060b-c58e-4f7f-8c46-f470a5de176d req-90972d1d-6f8f-4b6c-8cd2-99402774b362 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Received unexpected event network-vif-plugged-95244a55-3c22-4eb7-ada5-7c20002f8728 for instance with vm_state active and task_state None.
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.network.neutron [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Updating instance_info_cache with network_info: [{"id": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "address": "fa:16:3e:bb:12:6d", "network": {"id": "e3392f0b-2086-42ef-8292-84e785b0f697", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1543909989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "571b03a1cf0e43c28d8ca716b737c558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82340bab-a0", "ovs_interfaceid": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.484s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.019s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Releasing lock "refresh_cache-8946e093-6440-479f-95bc-c65391b9d2ba" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.compute.manager [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Instance network_info: |[{"id": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "address": "fa:16:3e:bb:12:6d", "network": {"id": "e3392f0b-2086-42ef-8292-84e785b0f697", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1543909989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "571b03a1cf0e43c28d8ca716b737c558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82340bab-a0", "ovs_interfaceid": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a2ff2f48-4a98-4a47-8f6f-5877c349d2a4 req-95fa1f47-c3a2-4883-8a8f-fb7bd25efd15 service nova] Acquired lock "refresh_cache-8946e093-6440-479f-95bc-c65391b9d2ba" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.network.neutron [req-a2ff2f48-4a98-4a47-8f6f-5877c349d2a4 req-95fa1f47-c3a2-4883-8a8f-fb7bd25efd15 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Refreshing network info cache for port 82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Start _get_guest_xml network_info=[{"id": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "address": "fa:16:3e:bb:12:6d", "network": {"id": "e3392f0b-2086-42ef-8292-84e785b0f697", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1543909989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "571b03a1cf0e43c28d8ca716b737c558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82340bab-a0", "ovs_interfaceid": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:39:19Z,direct_url=<?>,disk_format='qcow2',id=54529057-c114-4810-8a21-ad42318af10c,min_disk=0,min_ram=0,name='',owner='e6b9f126286b4fbba4a754a72dd566dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:39:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'scsi', 'boot_index': 0, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '54529057-c114-4810-8a21-ad42318af10c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:39:36 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:36 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:39:19Z,direct_url=<?>,disk_format='qcow2',id=54529057-c114-4810-8a21-ad42318af10c,min_disk=0,min_ram=0,name='',owner='e6b9f126286b4fbba4a754a72dd566dd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:39:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-308134010',display_name='tempest-AttachSCSIVolumeTestJSON-server-308134010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-308134010',id=7,image_ref='54529057-c114-4810-8a21-ad42318af10c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlP3S6Y1ty+raWZOVD93LwLkCZiTKDemNf55aXHYlf9JtmA6UmATNDme40n18ixRyRTurk2eR6kuA1qdIj+GCD7rzi20MUNT6tIiippnrLk0NFeLyHYLuWLzkGoT7jemg==',key_name='tempest-keypair-874873702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='571b03a1cf0e43c28d8ca716b737c558',ramdisk_id='',reservation_id='r-vrfk8scw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='54529057-c114-4810-8a21-ad42318af10c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-363758748',owner_user_name='tempest-AttachSCSIVolumeTestJSON-363758748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d39be3e2d4ad4f8daec0c0927edfbd59',uuid=8946e093-6440-479f-95bc-c65391b9d2ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "address": "fa:16:3e:bb:12:6d", "network": {"id": "e3392f0b-2086-42ef-8292-84e785b0f697", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1543909989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "571b03a1cf0e43c28d8ca716b737c558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82340bab-a0", "ovs_interfaceid": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Converting VIF {"id": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "address": "fa:16:3e:bb:12:6d", "network": {"id": "e3392f0b-2086-42ef-8292-84e785b0f697", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1543909989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "571b03a1cf0e43c28d8ca716b737c558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82340bab-a0", "ovs_interfaceid": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:12:6d,bridge_name='br-int',has_traffic_filtering=True,id=82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86,network=Network(e3392f0b-2086-42ef-8292-84e785b0f697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82340bab-a0') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lazy-loading 'pci_devices' on Instance uuid 8946e093-6440-479f-95bc-c65391b9d2ba {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.network.neutron [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Successfully created port: a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:39:36 user nova-compute[75826]:   <uuid>8946e093-6440-479f-95bc-c65391b9d2ba</uuid>
Nov 16 00:39:36 user nova-compute[75826]:   <name>instance-00000007</name>
Nov 16 00:39:36 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:39:36 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:39:36 user nova-compute[75826]:   <metadata>
Nov 16 00:39:36 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:39:36 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:39:36 user nova-compute[75826]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-308134010</nova:name>
Nov 16 00:39:36 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:39:36</nova:creationTime>
Nov 16 00:39:36 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:39:36 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:39:36 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:39:36 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:39:36 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:39:36 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:39:36 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:39:36 user nova-compute[75826]:       <nova:owner>
Nov 16 00:39:36 user nova-compute[75826]:         <nova:user uuid="d39be3e2d4ad4f8daec0c0927edfbd59">tempest-AttachSCSIVolumeTestJSON-363758748-project-member</nova:user>
Nov 16 00:39:36 user nova-compute[75826]:         <nova:project uuid="571b03a1cf0e43c28d8ca716b737c558">tempest-AttachSCSIVolumeTestJSON-363758748</nova:project>
Nov 16 00:39:36 user nova-compute[75826]:       </nova:owner>
Nov 16 00:39:36 user nova-compute[75826]:       <nova:root type="image" uuid="54529057-c114-4810-8a21-ad42318af10c"/>
Nov 16 00:39:36 user nova-compute[75826]:       <nova:ports>
Nov 16 00:39:36 user nova-compute[75826]:         <nova:port uuid="82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86">
Nov 16 00:39:36 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 00:39:36 user nova-compute[75826]:         </nova:port>
Nov 16 00:39:36 user nova-compute[75826]:       </nova:ports>
Nov 16 00:39:36 user nova-compute[75826]:     </nova:instance>
Nov 16 00:39:36 user nova-compute[75826]:   </metadata>
Nov 16 00:39:36 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:39:36 user nova-compute[75826]:     <system>
Nov 16 00:39:36 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:39:36 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:39:36 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:39:36 user nova-compute[75826]:       <entry name="serial">8946e093-6440-479f-95bc-c65391b9d2ba</entry>
Nov 16 00:39:36 user nova-compute[75826]:       <entry name="uuid">8946e093-6440-479f-95bc-c65391b9d2ba</entry>
Nov 16 00:39:36 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:39:36 user nova-compute[75826]:     </system>
Nov 16 00:39:36 user nova-compute[75826]:   </sysinfo>
Nov 16 00:39:36 user nova-compute[75826]:   <os>
Nov 16 00:39:36 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:39:36 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:39:36 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:39:36 user nova-compute[75826]:   </os>
Nov 16 00:39:36 user nova-compute[75826]:   <features>
Nov 16 00:39:36 user nova-compute[75826]:     <acpi/>
Nov 16 00:39:36 user nova-compute[75826]:     <apic/>
Nov 16 00:39:36 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:39:36 user nova-compute[75826]:   </features>
Nov 16 00:39:36 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:39:36 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:39:36 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:39:36 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:39:36 user nova-compute[75826]:   </clock>
Nov 16 00:39:36 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:39:36 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:39:36 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:39:36 user nova-compute[75826]:   </cpu>
Nov 16 00:39:36 user nova-compute[75826]:   <devices>
Nov 16 00:39:36 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:39:36 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:39:36 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk"/>
Nov 16 00:39:36 user nova-compute[75826]:       <target dev="sda" bus="scsi"/>
Nov 16 00:39:36 user nova-compute[75826]:       <address type="drive" controller="0" unit="0"/>
Nov 16 00:39:36 user nova-compute[75826]:     </disk>
Nov 16 00:39:36 user nova-compute[75826]:     <disk type="file" device="cdrom">
Nov 16 00:39:36 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 00:39:36 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk.config"/>
Nov 16 00:39:36 user nova-compute[75826]:       <target dev="sdb" bus="scsi"/>
Nov 16 00:39:36 user nova-compute[75826]:       <address type="drive" controller="0" unit="1"/>
Nov 16 00:39:36 user nova-compute[75826]:     </disk>
Nov 16 00:39:36 user nova-compute[75826]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 16 00:39:36 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:39:36 user nova-compute[75826]:       <mac address="fa:16:3e:bb:12:6d"/>
Nov 16 00:39:36 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:36 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:39:36 user nova-compute[75826]:       <target dev="tap82340bab-a0"/>
Nov 16 00:39:36 user nova-compute[75826]:     </interface>
Nov 16 00:39:36 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:39:36 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/console.log" append="off"/>
Nov 16 00:39:36 user nova-compute[75826]:     </serial>
Nov 16 00:39:36 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:39:36 user nova-compute[75826]:     <video>
Nov 16 00:39:36 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:36 user nova-compute[75826]:     </video>
Nov 16 00:39:36 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:39:36 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:39:36 user nova-compute[75826]:     </rng>
Nov 16 00:39:36 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:39:36 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:39:36 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:39:36 user nova-compute[75826]:     </memballoon>
Nov 16 00:39:36 user nova-compute[75826]:   </devices>
Nov 16 00:39:36 user nova-compute[75826]: </domain>
Nov 16 00:39:36 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-308134010',display_name='tempest-AttachSCSIVolumeTestJSON-server-308134010',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-308134010',id=7,image_ref='54529057-c114-4810-8a21-ad42318af10c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlP3S6Y1ty+raWZOVD93LwLkCZiTKDemNf55aXHYlf9JtmA6UmATNDme40n18ixRyRTurk2eR6kuA1qdIj+GCD7rzi20MUNT6tIiippnrLk0NFeLyHYLuWLzkGoT7jemg==',key_name='tempest-keypair-874873702',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='571b03a1cf0e43c28d8ca716b737c558',ramdisk_id='',reservation_id='r-vrfk8scw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='54529057-c114-4810-8a21-ad42318af10c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-363758748',owner_user_name='tempest-AttachSCSIVolumeTestJSON-363758748-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d39be3e2d4ad4f8daec0c0927edfbd59',uuid=8946e093-6440-479f-95bc-c65391b9d2ba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "address": "fa:16:3e:bb:12:6d", "network": {"id": "e3392f0b-2086-42ef-8292-84e785b0f697", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1543909989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "571b03a1cf0e43c28d8ca716b737c558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82340bab-a0", "ovs_interfaceid": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Converting VIF {"id": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "address": "fa:16:3e:bb:12:6d", "network": {"id": "e3392f0b-2086-42ef-8292-84e785b0f697", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1543909989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "571b03a1cf0e43c28d8ca716b737c558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82340bab-a0", "ovs_interfaceid": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:12:6d,bridge_name='br-int',has_traffic_filtering=True,id=82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86,network=Network(e3392f0b-2086-42ef-8292-84e785b0f697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82340bab-a0') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG os_vif [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:12:6d,bridge_name='br-int',has_traffic_filtering=True,id=82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86,network=Network(e3392f0b-2086-42ef-8292-84e785b0f697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82340bab-a0') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc1fec61-7574-5efa-b27c-4408ff625a5a', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82340bab-a0, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap82340bab-a0, col_values=(('qos', UUID('cf3b477b-9cdd-4f34-906c-d45ce98160cb')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap82340bab-a0, col_values=(('external_ids', {'iface-id': '82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:12:6d', 'vm-uuid': '8946e093-6440-479f-95bc-c65391b9d2ba'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:36 user nova-compute[75826]: INFO os_vif [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:12:6d,bridge_name='br-int',has_traffic_filtering=True,id=82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86,network=Network(e3392f0b-2086-42ef-8292-84e785b0f697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82340bab-a0')
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.387s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk 1073741824" returned: 0 in 0.094s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.491s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] No BDM found with device name sda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] No VIF found with MAC fa:16:3e:bb:12:6d, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:39:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Using config drive
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.254s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Checking if we can resize image /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Cannot resize image /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Ensure instance console log exists: /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Creating config drive at /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk.config
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjiogbdrc {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:37 user sudo[85839]: pam_unix(sudo:session): session closed for user root
Nov 16 00:39:37 user nova-compute[75826]: INFO oslo.privsep.daemon [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Spawned new privsep daemon via rootwrap
Nov 16 00:39:37 user nova-compute[75826]: DEBUG nova.network.neutron [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Successfully created port: ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:37 user nova-compute[75826]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 16 00:39:37 user nova-compute[75826]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 16 00:39:37 user nova-compute[75826]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 16 00:39:37 user nova-compute[75826]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85991
Nov 16 00:39:37 user nova-compute[75826]: DEBUG nova.compute.manager [req-9847092a-4133-45e2-b8d8-f6bdf198b9b6 req-dd98e7e9-4e9c-41b2-87a5-f58199d0ce50 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Received event network-vif-plugged-378f1586-075a-47fc-8723-540896093fe4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9847092a-4133-45e2-b8d8-f6bdf198b9b6 req-dd98e7e9-4e9c-41b2-87a5-f58199d0ce50 service nova] Acquiring lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9847092a-4133-45e2-b8d8-f6bdf198b9b6 req-dd98e7e9-4e9c-41b2-87a5-f58199d0ce50 service nova] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9847092a-4133-45e2-b8d8-f6bdf198b9b6 req-dd98e7e9-4e9c-41b2-87a5-f58199d0ce50 service nova] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG nova.compute.manager [req-9847092a-4133-45e2-b8d8-f6bdf198b9b6 req-dd98e7e9-4e9c-41b2-87a5-f58199d0ce50 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] No waiting events found dispatching network-vif-plugged-378f1586-075a-47fc-8723-540896093fe4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:37 user nova-compute[75826]: WARNING nova.compute.manager [req-9847092a-4133-45e2-b8d8-f6bdf198b9b6 req-dd98e7e9-4e9c-41b2-87a5-f58199d0ce50 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Received unexpected event network-vif-plugged-378f1586-075a-47fc-8723-540896093fe4 for instance with vm_state active and task_state None.
Nov 16 00:39:37 user nova-compute[75826]: DEBUG nova.compute.manager [req-9847092a-4133-45e2-b8d8-f6bdf198b9b6 req-dd98e7e9-4e9c-41b2-87a5-f58199d0ce50 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Received event network-vif-plugged-378f1586-075a-47fc-8723-540896093fe4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9847092a-4133-45e2-b8d8-f6bdf198b9b6 req-dd98e7e9-4e9c-41b2-87a5-f58199d0ce50 service nova] Acquiring lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9847092a-4133-45e2-b8d8-f6bdf198b9b6 req-dd98e7e9-4e9c-41b2-87a5-f58199d0ce50 service nova] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9847092a-4133-45e2-b8d8-f6bdf198b9b6 req-dd98e7e9-4e9c-41b2-87a5-f58199d0ce50 service nova] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:37 user nova-compute[75826]: DEBUG nova.compute.manager [req-9847092a-4133-45e2-b8d8-f6bdf198b9b6 req-dd98e7e9-4e9c-41b2-87a5-f58199d0ce50 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] No waiting events found dispatching network-vif-plugged-378f1586-075a-47fc-8723-540896093fe4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:37 user nova-compute[75826]: WARNING nova.compute.manager [req-9847092a-4133-45e2-b8d8-f6bdf198b9b6 req-dd98e7e9-4e9c-41b2-87a5-f58199d0ce50 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Received unexpected event network-vif-plugged-378f1586-075a-47fc-8723-540896093fe4 for instance with vm_state active and task_state None.
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjiogbdrc" returned: 0 in 0.272s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2283ad1f-4747-44b8-9614-d087bfd31cac]: (2,) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG nova.network.neutron [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Successfully updated port: a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[561cf7f3-6608-44f6-870f-ed6324fcb814]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:38 user nova-compute[75826]: WARNING os_brick.initiator.connectors.nvmeof [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG nova.network.neutron [req-a2ff2f48-4a98-4a47-8f6f-5877c349d2a4 req-95fa1f47-c3a2-4883-8a8f-fb7bd25efd15 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Updated VIF entry in instance network info cache for port 82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG nova.network.neutron [req-a2ff2f48-4a98-4a47-8f6f-5877c349d2a4 req-95fa1f47-c3a2-4883-8a8f-fb7bd25efd15 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Updating instance_info_cache with network_info: [{"id": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "address": "fa:16:3e:bb:12:6d", "network": {"id": "e3392f0b-2086-42ef-8292-84e785b0f697", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1543909989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "571b03a1cf0e43c28d8ca716b737c558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82340bab-a0", "ovs_interfaceid": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "refresh_cache-33f2b149-1951-44d0-a65a-018316b31712" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquired lock "refresh_cache-33f2b149-1951-44d0-a65a-018316b31712" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG nova.network.neutron [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.037s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c34ff4f-994c-48ab-9e13-8d14370a07ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a2ff2f48-4a98-4a47-8f6f-5877c349d2a4 req-95fa1f47-c3a2-4883-8a8f-fb7bd25efd15 service nova] Releasing lock "refresh_cache-8946e093-6440-479f-95bc-c65391b9d2ba" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[886b992d-8feb-4fde-9518-191ad726cfae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[48311a25-0fb7-44a6-9985-e46339c119ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-245061dc-f16b-44d1-9955-fc2b2ec1dca8 req-7a12fa27-dbdd-4b48-8ef8-e8dc2266acc2 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received event network-changed-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-245061dc-f16b-44d1-9955-fc2b2ec1dca8 req-7a12fa27-dbdd-4b48-8ef8-e8dc2266acc2 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Refreshing instance network info cache due to event network-changed-a3083677-00f2-46e4-be46-fe34b463d6a4. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-245061dc-f16b-44d1-9955-fc2b2ec1dca8 req-7a12fa27-dbdd-4b48-8ef8-e8dc2266acc2 service nova] Acquiring lock "refresh_cache-33f2b149-1951-44d0-a65a-018316b31712" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:39:38 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:39:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e434abc8-98ea-495a-8a4c-befd91736973]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG os_brick.utils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] <== get_connector_properties: return (4483ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Updating existing volume attachment record: 49e3fa67-91bf-4d85-b785-507079f4f0c0 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG nova.network.neutron [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:39:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Updating instance_info_cache with network_info: [{"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Releasing lock "refresh_cache-33f2b149-1951-44d0-a65a-018316b31712" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Instance network_info: |[{"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-245061dc-f16b-44d1-9955-fc2b2ec1dca8 req-7a12fa27-dbdd-4b48-8ef8-e8dc2266acc2 service nova] Acquired lock "refresh_cache-33f2b149-1951-44d0-a65a-018316b31712" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.network.neutron [req-245061dc-f16b-44d1-9955-fc2b2ec1dca8 req-7a12fa27-dbdd-4b48-8ef8-e8dc2266acc2 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Refreshing network info cache for port a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:39:39 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Instance spawned successfully.
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:39 user nova-compute[75826]: INFO nova.compute.manager [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Took 13.17 seconds to spawn the instance on the hypervisor.
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:39:39 user nova-compute[75826]: INFO nova.compute.manager [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Took 14.71 seconds to build instance.
Nov 16 00:39:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-899b6392-0ec2-4a4b-a4e3-e9e71aa3900c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.933s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Successfully updated port: ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquired lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:39:39 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Instance spawned successfully.
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.network.neutron [req-245061dc-f16b-44d1-9955-fc2b2ec1dca8 req-7a12fa27-dbdd-4b48-8ef8-e8dc2266acc2 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Updated VIF entry in instance network info cache for port a3083677-00f2-46e4-be46-fe34b463d6a4. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:39:39 user nova-compute[75826]: DEBUG nova.network.neutron [req-245061dc-f16b-44d1-9955-fc2b2ec1dca8 req-7a12fa27-dbdd-4b48-8ef8-e8dc2266acc2 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Updating instance_info_cache with network_info: [{"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-245061dc-f16b-44d1-9955-fc2b2ec1dca8 req-7a12fa27-dbdd-4b48-8ef8-e8dc2266acc2 service nova] Releasing lock "refresh_cache-33f2b149-1951-44d0-a65a-018316b31712" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:40 user nova-compute[75826]: INFO nova.compute.manager [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Took 12.57 seconds to spawn the instance on the hypervisor.
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:39:40 user nova-compute[75826]: INFO nova.compute.manager [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Took 14.02 seconds to build instance.
Nov 16 00:39:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a8b4b722-ec87-446b-975e-5ac866a82af4 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.330s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.network.neutron [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Updating instance_info_cache with network_info: [{"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Releasing lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.compute.manager [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Instance network_info: |[{"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Start _get_guest_xml network_info=[{"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:40 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:40 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbcbd70c-acbc-4144-8bdb-e8cb11521e0e req-21a2776d-c11e-4bcd-afef-c4c488c233a0 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-changed-ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbcbd70c-acbc-4144-8bdb-e8cb11521e0e req-21a2776d-c11e-4bcd-afef-c4c488c233a0 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Refreshing instance network info cache due to event network-changed-ebabaf39-8f6c-4790-b555-271d5aef9db8. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbcbd70c-acbc-4144-8bdb-e8cb11521e0e req-21a2776d-c11e-4bcd-afef-c4c488c233a0 service nova] Acquiring lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbcbd70c-acbc-4144-8bdb-e8cb11521e0e req-21a2776d-c11e-4bcd-afef-c4c488c233a0 service nova] Acquired lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.network.neutron [req-fbcbd70c-acbc-4144-8bdb-e8cb11521e0e req-21a2776d-c11e-4bcd-afef-c4c488c233a0 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Refreshing network info cache for port ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73313562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73313562',id=9,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcxgQNIwtABwmWWY66lpLW4FahMujB4sq8+awLbY3j4T0F+WRfv6pOgZdlOEfsFFgqQNg0M3KAfXMF/9LBbJOCDmKtj5c59DNwM9T0+YoH3Fun1L1tu/xueB5ab2B1nPg==',key_name='tempest-keypair-1839588636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e313a75f9fc4e91b5866d0228336b0b',ramdisk_id='',reservation_id='r-1vf0ms0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2144441547',owner_user_name='tempest-TaggedAttachmentsTest-2144441547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='159de45699cb47c68211051c7f62dae4',uuid=203da1ce-e5b1-4a16-a75e-e934c68d6e68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converting VIF {"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:17:39,bridge_name='br-int',has_traffic_filtering=True,id=ebabaf39-8f6c-4790-b555-271d5aef9db8,network=Network(5387e407-2541-49fb-a8ba-c80d318e4b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebabaf39-8f') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.objects.instance [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lazy-loading 'pci_devices' on Instance uuid 203da1ce-e5b1-4a16-a75e-e934c68d6e68 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:39:40 user nova-compute[75826]:   <uuid>203da1ce-e5b1-4a16-a75e-e934c68d6e68</uuid>
Nov 16 00:39:40 user nova-compute[75826]:   <name>instance-00000009</name>
Nov 16 00:39:40 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:39:40 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:39:40 user nova-compute[75826]:   <metadata>
Nov 16 00:39:40 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:39:40 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:39:40 user nova-compute[75826]:       <nova:name>tempest-device-tagging-server-73313562</nova:name>
Nov 16 00:39:40 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:39:40</nova:creationTime>
Nov 16 00:39:40 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:39:40 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:39:40 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:39:40 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:39:40 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:39:40 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:39:40 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:39:40 user nova-compute[75826]:       <nova:owner>
Nov 16 00:39:40 user nova-compute[75826]:         <nova:user uuid="159de45699cb47c68211051c7f62dae4">tempest-TaggedAttachmentsTest-2144441547-project-member</nova:user>
Nov 16 00:39:40 user nova-compute[75826]:         <nova:project uuid="6e313a75f9fc4e91b5866d0228336b0b">tempest-TaggedAttachmentsTest-2144441547</nova:project>
Nov 16 00:39:40 user nova-compute[75826]:       </nova:owner>
Nov 16 00:39:40 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:39:40 user nova-compute[75826]:       <nova:ports>
Nov 16 00:39:40 user nova-compute[75826]:         <nova:port uuid="ebabaf39-8f6c-4790-b555-271d5aef9db8">
Nov 16 00:39:40 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:39:40 user nova-compute[75826]:         </nova:port>
Nov 16 00:39:40 user nova-compute[75826]:       </nova:ports>
Nov 16 00:39:40 user nova-compute[75826]:     </nova:instance>
Nov 16 00:39:40 user nova-compute[75826]:   </metadata>
Nov 16 00:39:40 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:39:40 user nova-compute[75826]:     <system>
Nov 16 00:39:40 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:39:40 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:39:40 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:39:40 user nova-compute[75826]:       <entry name="serial">203da1ce-e5b1-4a16-a75e-e934c68d6e68</entry>
Nov 16 00:39:40 user nova-compute[75826]:       <entry name="uuid">203da1ce-e5b1-4a16-a75e-e934c68d6e68</entry>
Nov 16 00:39:40 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:39:40 user nova-compute[75826]:     </system>
Nov 16 00:39:40 user nova-compute[75826]:   </sysinfo>
Nov 16 00:39:40 user nova-compute[75826]:   <os>
Nov 16 00:39:40 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:39:40 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:39:40 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:39:40 user nova-compute[75826]:   </os>
Nov 16 00:39:40 user nova-compute[75826]:   <features>
Nov 16 00:39:40 user nova-compute[75826]:     <acpi/>
Nov 16 00:39:40 user nova-compute[75826]:     <apic/>
Nov 16 00:39:40 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:39:40 user nova-compute[75826]:   </features>
Nov 16 00:39:40 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:39:40 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:39:40 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:39:40 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:39:40 user nova-compute[75826]:   </clock>
Nov 16 00:39:40 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:39:40 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:39:40 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:39:40 user nova-compute[75826]:   </cpu>
Nov 16 00:39:40 user nova-compute[75826]:   <devices>
Nov 16 00:39:40 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:39:40 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:39:40 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk"/>
Nov 16 00:39:40 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:39:40 user nova-compute[75826]:     </disk>
Nov 16 00:39:40 user nova-compute[75826]:     <disk type="file" device="cdrom">
Nov 16 00:39:40 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 00:39:40 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk.config"/>
Nov 16 00:39:40 user nova-compute[75826]:       <target dev="hda" bus="ide"/>
Nov 16 00:39:40 user nova-compute[75826]:     </disk>
Nov 16 00:39:40 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:39:40 user nova-compute[75826]:       <mac address="fa:16:3e:d3:17:39"/>
Nov 16 00:39:40 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:40 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:39:40 user nova-compute[75826]:       <target dev="tapebabaf39-8f"/>
Nov 16 00:39:40 user nova-compute[75826]:     </interface>
Nov 16 00:39:40 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:39:40 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/console.log" append="off"/>
Nov 16 00:39:40 user nova-compute[75826]:     </serial>
Nov 16 00:39:40 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:39:40 user nova-compute[75826]:     <video>
Nov 16 00:39:40 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:40 user nova-compute[75826]:     </video>
Nov 16 00:39:40 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:39:40 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:39:40 user nova-compute[75826]:     </rng>
Nov 16 00:39:40 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:39:40 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:39:40 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:39:40 user nova-compute[75826]:     </memballoon>
Nov 16 00:39:40 user nova-compute[75826]:   </devices>
Nov 16 00:39:40 user nova-compute[75826]: </domain>
Nov 16 00:39:40 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73313562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73313562',id=9,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcxgQNIwtABwmWWY66lpLW4FahMujB4sq8+awLbY3j4T0F+WRfv6pOgZdlOEfsFFgqQNg0M3KAfXMF/9LBbJOCDmKtj5c59DNwM9T0+YoH3Fun1L1tu/xueB5ab2B1nPg==',key_name='tempest-keypair-1839588636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e313a75f9fc4e91b5866d0228336b0b',ramdisk_id='',reservation_id='r-1vf0ms0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-2144441547',owner_user_name='tempest-TaggedAttachmentsTest-2144441547-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='159de45699cb47c68211051c7f62dae4',uuid=203da1ce-e5b1-4a16-a75e-e934c68d6e68,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converting VIF {"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:17:39,bridge_name='br-int',has_traffic_filtering=True,id=ebabaf39-8f6c-4790-b555-271d5aef9db8,network=Network(5387e407-2541-49fb-a8ba-c80d318e4b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebabaf39-8f') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG os_vif [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:17:39,bridge_name='br-int',has_traffic_filtering=True,id=ebabaf39-8f6c-4790-b555-271d5aef9db8,network=Network(5387e407-2541-49fb-a8ba-c80d318e4b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebabaf39-8f') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9b2a6cbf-d936-5c7e-896e-da5aeb1a763d', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebabaf39-8f, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebabaf39-8f, col_values=(('qos', UUID('b7baf9d5-9801-44b0-9f38-806749c5188c')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebabaf39-8f, col_values=(('external_ids', {'iface-id': 'ebabaf39-8f6c-4790-b555-271d5aef9db8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:17:39', 'vm-uuid': '203da1ce-e5b1-4a16-a75e-e934c68d6e68'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:40 user nova-compute[75826]: INFO os_vif [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:17:39,bridge_name='br-int',has_traffic_filtering=True,id=ebabaf39-8f6c-4790-b555-271d5aef9db8,network=Network(5387e407-2541-49fb-a8ba-c80d318e4b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebabaf39-8f')
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] No BDM found with device name hda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:39:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] No VIF found with MAC fa:16:3e:d3:17:39, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:39:40 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Using config drive
Nov 16 00:39:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-fbcbd70c-acbc-4144-8bdb-e8cb11521e0e req-21a2776d-c11e-4bcd-afef-c4c488c233a0 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Updated VIF entry in instance network info cache for port ebabaf39-8f6c-4790-b555-271d5aef9db8. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:39:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-fbcbd70c-acbc-4144-8bdb-e8cb11521e0e req-21a2776d-c11e-4bcd-afef-c4c488c233a0 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Updating instance_info_cache with network_info: [{"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbcbd70c-acbc-4144-8bdb-e8cb11521e0e req-21a2776d-c11e-4bcd-afef-c4c488c233a0 service nova] Releasing lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-a30e08f4-b4ef-4b35-8915-e717a2e42d7c req-852fa792-0d4a-4ae1-b04c-624d01e4dde5 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a30e08f4-b4ef-4b35-8915-e717a2e42d7c req-852fa792-0d4a-4ae1-b04c-624d01e4dde5 service nova] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a30e08f4-b4ef-4b35-8915-e717a2e42d7c req-852fa792-0d4a-4ae1-b04c-624d01e4dde5 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a30e08f4-b4ef-4b35-8915-e717a2e42d7c req-852fa792-0d4a-4ae1-b04c-624d01e4dde5 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-a30e08f4-b4ef-4b35-8915-e717a2e42d7c req-852fa792-0d4a-4ae1-b04c-624d01e4dde5 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] No waiting events found dispatching network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:41 user nova-compute[75826]: WARNING nova.compute.manager [req-a30e08f4-b4ef-4b35-8915-e717a2e42d7c req-852fa792-0d4a-4ae1-b04c-624d01e4dde5 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received unexpected event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc for instance with vm_state active and task_state None.
Nov 16 00:39:41 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Creating config drive at /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk.config
Nov 16 00:39:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpelibq8iw {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpelibq8iw" returned: 0 in 0.062s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:39:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:39:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Instance spawned successfully.
Nov 16 00:39:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:39:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:42 user nova-compute[75826]: INFO nova.compute.manager [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Took 10.18 seconds to spawn the instance on the hypervisor.
Nov 16 00:39:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:39:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:42 user nova-compute[75826]: INFO nova.compute.manager [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Took 11.98 seconds to build instance.
Nov 16 00:39:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e2bb0190-692f-472b-95c2-3c87820055b9 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "8946e093-6440-479f-95bc-c65391b9d2ba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.150s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] No waiting events found dispatching network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:43 user nova-compute[75826]: WARNING nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received unexpected event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc for instance with vm_state active and task_state None.
Nov 16 00:39:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Received event network-vif-plugged-e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Acquiring lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] No waiting events found dispatching network-vif-plugged-e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:43 user nova-compute[75826]: WARNING nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Received unexpected event network-vif-plugged-e7134fec-93d3-43b3-ba14-b08aa94c3cdf for instance with vm_state active and task_state None.
Nov 16 00:39:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Received event network-vif-plugged-e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Acquiring lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] No waiting events found dispatching network-vif-plugged-e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:43 user nova-compute[75826]: WARNING nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Received unexpected event network-vif-plugged-e7134fec-93d3-43b3-ba14-b08aa94c3cdf for instance with vm_state active and task_state None.
Nov 16 00:39:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Received event network-vif-plugged-ffeb91d2-58af-4045-9800-31518faad394 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Acquiring lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] No waiting events found dispatching network-vif-plugged-ffeb91d2-58af-4045-9800-31518faad394 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:43 user nova-compute[75826]: WARNING nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Received unexpected event network-vif-plugged-ffeb91d2-58af-4045-9800-31518faad394 for instance with vm_state active and task_state None.
Nov 16 00:39:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Received event network-vif-plugged-ffeb91d2-58af-4045-9800-31518faad394 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Acquiring lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] No waiting events found dispatching network-vif-plugged-ffeb91d2-58af-4045-9800-31518faad394 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:43 user nova-compute[75826]: WARNING nova.compute.manager [req-ab907177-3c0d-40d7-b3ed-7518f948569e req-db20e7fc-ba6f-4584-8bf2-5a49d39a87a9 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Received unexpected event network-vif-plugged-ffeb91d2-58af-4045-9800-31518faad394 for instance with vm_state active and task_state None.
Nov 16 00:39:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Acquiring lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:43 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:39:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:44 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:39:44 user nova-compute[75826]: INFO nova.compute.claims [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Claim successful on node user
Nov 16 00:39:44 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:39:44 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:39:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:39:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:39:44 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:39:44 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:39:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:39:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:39:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:39:44 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Creating image(s)
Nov 16 00:39:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Acquiring lock "/opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "/opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "/opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG nova.policy [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f3b20fdea3b44754b31ffb9baee27bbf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6fe51852d2e4213876d2bcba378c427', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.232s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.242s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk 1073741824" returned: 0 in 0.064s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG nova.compute.manager [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:39:45 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Instance spawned successfully.
Nov 16 00:39:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.229s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:39:46 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Creating image(s)
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Ensure instance console log exists: /opt/stack/data/nova/instances/33f2b149-1951-44d0-a65a-018316b31712/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Start _get_guest_xml network_info=[{"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '49e3fa67-91bf-4d85-b785-507079f4f0c0', 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbUymzfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33f2b149-1951-44d0-a65a-018316b31712', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef9dbcbd-3c51-40de-bfc8-4519b8543632', 'serial': 'ef9dbcbd-3c51-40de-bfc8-4519b8543632'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:39:46 user nova-compute[75826]: INFO nova.compute.manager [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Took 9.97 seconds to spawn the instance on the hypervisor.
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:46 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:46 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Cannot resize image /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Ensure instance console log exists: /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connector [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Factory for ISCSI on None {{(pid=75826) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbUymzfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:39:46 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:39:46 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:39:46 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[738029a1-9f37-4439-a54f-fd1ee7c93743]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:39:46 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f2e52f-3624-4cdf-b11a-3f0b871cd69d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632] added
Nov 16 00:39:46 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:46 user nova-compute[75826]: INFO nova.compute.manager [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Took 12.56 seconds to build instance.
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fca02f-2bcd-4bb1-8324-ea304ecdd310]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b68ba4be-d8af-4a90-9fcb-ac1e816f2247 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.865s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b281fa9b-ef7c-464f-b2d9-065bb9dfc3d6]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbUymzfW {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbUymzfW" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff57d3b-0544-4b5b-b588-11098d1b1963]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xbUymzfW'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[669a80d7-2676-4710-8e16-27c3d62778fa]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a29e2f7-725a-4724-997b-b6a3f5ec0b83]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 00:39:46 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 00:39:46 user nova-compute[75826]:  {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:39:46 user nova-compute[75826]: WARNING os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 00:39:46 user nova-compute[75826]: 
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ef6fc5-0419-4d9d-ab67-6fb24cdb74e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260]
Nov 16 00:39:46 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260] successful.
Nov 16 00:39:46 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4789f9-a08b-40ad-8cb7-b81f79c35739]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Successfully created port: 72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bac913d-8eeb-4cc1-87ef-61db3f5b47cc]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:39:46 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:39:46 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[725d9c97-cc2a-4312-b878-29577ca961ec]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:39:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbUymzfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Successfully updated port: 72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Acquiring lock "refresh_cache-4e2d6eb9-c31e-487c-807d-3bb8460f3a02" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Acquired lock "refresh_cache-4e2d6eb9-c31e-487c-807d-3bb8460f3a02" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-14232b79-50c1-4566-831d-7b708436aded req-a01360b7-2a30-4124-857a-d578d3fbb198 service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Received event network-changed-72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-14232b79-50c1-4566-831d-7b708436aded req-a01360b7-2a30-4124-857a-d578d3fbb198 service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Refreshing instance network info cache due to event network-changed-72a2f5c9-f73f-4207-926b-8b82e845f8b3. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-14232b79-50c1-4566-831d-7b708436aded req-a01360b7-2a30-4124-857a-d578d3fbb198 service nova] Acquiring lock "refresh_cache-4e2d6eb9-c31e-487c-807d-3bb8460f3a02" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '23338393733663037', 'path': '/dev/sdb'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338393733663037', 'path': '/dev/sdb'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1379364694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1379364694',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCXS8mfCk4vTQ8KvD02SkTq5b8gadS3Dv2Lo+h6cewehr3vqpTDQTQHj0qaShguaufSxu99avO/2zXpxPkqDPHOswK5I94kwnDiKdL++s2lPV/rz6rgG0dXcQu0zhVySw==',key_name='tempest-keypair-1471744927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b28d760459a430b9116e57172e64a77',ramdisk_id='',reservation_id='r-qvs9it1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1015349843',owner_user_name='tempest-ServerActionsV293TestJSON-1015349843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44daf19202c4460a56205d614f05118',uuid=33f2b149-1951-44d0-a65a-018316b31712,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Converting VIF {"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.objects.instance [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lazy-loading 'pci_devices' on Instance uuid 33f2b149-1951-44d0-a65a-018316b31712 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:39:47 user nova-compute[75826]:   <uuid>33f2b149-1951-44d0-a65a-018316b31712</uuid>
Nov 16 00:39:47 user nova-compute[75826]:   <name>instance-00000008</name>
Nov 16 00:39:47 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:39:47 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:39:47 user nova-compute[75826]:   <metadata>
Nov 16 00:39:47 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:39:47 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:39:47 user nova-compute[75826]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1379364694</nova:name>
Nov 16 00:39:47 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:39:46</nova:creationTime>
Nov 16 00:39:47 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:39:47 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:39:47 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:39:47 user nova-compute[75826]:       <nova:owner>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:user uuid="d44daf19202c4460a56205d614f05118">tempest-ServerActionsV293TestJSON-1015349843-project-member</nova:user>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:project uuid="7b28d760459a430b9116e57172e64a77">tempest-ServerActionsV293TestJSON-1015349843</nova:project>
Nov 16 00:39:47 user nova-compute[75826]:       </nova:owner>
Nov 16 00:39:47 user nova-compute[75826]:       <nova:ports>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:port uuid="a3083677-00f2-46e4-be46-fe34b463d6a4">
Nov 16 00:39:47 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:39:47 user nova-compute[75826]:         </nova:port>
Nov 16 00:39:47 user nova-compute[75826]:       </nova:ports>
Nov 16 00:39:47 user nova-compute[75826]:     </nova:instance>
Nov 16 00:39:47 user nova-compute[75826]:   </metadata>
Nov 16 00:39:47 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:39:47 user nova-compute[75826]:     <system>
Nov 16 00:39:47 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:39:47 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:39:47 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:39:47 user nova-compute[75826]:       <entry name="serial">33f2b149-1951-44d0-a65a-018316b31712</entry>
Nov 16 00:39:47 user nova-compute[75826]:       <entry name="uuid">33f2b149-1951-44d0-a65a-018316b31712</entry>
Nov 16 00:39:47 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:39:47 user nova-compute[75826]:     </system>
Nov 16 00:39:47 user nova-compute[75826]:   </sysinfo>
Nov 16 00:39:47 user nova-compute[75826]:   <os>
Nov 16 00:39:47 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:39:47 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:39:47 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:39:47 user nova-compute[75826]:   </os>
Nov 16 00:39:47 user nova-compute[75826]:   <features>
Nov 16 00:39:47 user nova-compute[75826]:     <acpi/>
Nov 16 00:39:47 user nova-compute[75826]:     <apic/>
Nov 16 00:39:47 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:39:47 user nova-compute[75826]:   </features>
Nov 16 00:39:47 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:39:47 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:39:47 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:39:47 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:39:47 user nova-compute[75826]:   </clock>
Nov 16 00:39:47 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:39:47 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:39:47 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:39:47 user nova-compute[75826]:   </cpu>
Nov 16 00:39:47 user nova-compute[75826]:   <devices>
Nov 16 00:39:47 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:39:47 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:39:47 user nova-compute[75826]:       <source dev="/dev/sdb"/>
Nov 16 00:39:47 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:39:47 user nova-compute[75826]:       <serial>ef9dbcbd-3c51-40de-bfc8-4519b8543632</serial>
Nov 16 00:39:47 user nova-compute[75826]:     </disk>
Nov 16 00:39:47 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:39:47 user nova-compute[75826]:       <mac address="fa:16:3e:e2:5d:c2"/>
Nov 16 00:39:47 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:47 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:39:47 user nova-compute[75826]:       <target dev="tapa3083677-00"/>
Nov 16 00:39:47 user nova-compute[75826]:     </interface>
Nov 16 00:39:47 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:39:47 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/33f2b149-1951-44d0-a65a-018316b31712/console.log" append="off"/>
Nov 16 00:39:47 user nova-compute[75826]:     </serial>
Nov 16 00:39:47 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:39:47 user nova-compute[75826]:     <video>
Nov 16 00:39:47 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:47 user nova-compute[75826]:     </video>
Nov 16 00:39:47 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:39:47 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:39:47 user nova-compute[75826]:     </rng>
Nov 16 00:39:47 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:39:47 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:39:47 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:39:47 user nova-compute[75826]:     </memballoon>
Nov 16 00:39:47 user nova-compute[75826]:   </devices>
Nov 16 00:39:47 user nova-compute[75826]: </domain>
Nov 16 00:39:47 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1379364694',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1379364694',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCXS8mfCk4vTQ8KvD02SkTq5b8gadS3Dv2Lo+h6cewehr3vqpTDQTQHj0qaShguaufSxu99avO/2zXpxPkqDPHOswK5I94kwnDiKdL++s2lPV/rz6rgG0dXcQu0zhVySw==',key_name='tempest-keypair-1471744927',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7b28d760459a430b9116e57172e64a77',ramdisk_id='',reservation_id='r-qvs9it1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1015349843',owner_user_name='tempest-ServerActionsV293TestJSON-1015349843-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44daf19202c4460a56205d614f05118',uuid=33f2b149-1951-44d0-a65a-018316b31712,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Converting VIF {"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG os_vif [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb372929-5ede-55dc-a390-7129e805063c', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3083677-00, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3083677-00, col_values=(('qos', UUID('0d2c9385-4c57-4067-a8a4-5f521f72396a')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3083677-00, col_values=(('external_ids', {'iface-id': 'a3083677-00f2-46e4-be46-fe34b463d6a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:5d:c2', 'vm-uuid': '33f2b149-1951-44d0-a65a-018316b31712'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Updating instance_info_cache with network_info: [{"id": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "address": "fa:16:3e:78:d0:a7", "network": {"id": "dad71101-cc46-4510-bd10-70173e431b9f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-774900563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe51852d2e4213876d2bcba378c427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2f5c9-f7", "ovs_interfaceid": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:47 user nova-compute[75826]: INFO os_vif [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00')
Nov 16 00:39:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Releasing lock "refresh_cache-4e2d6eb9-c31e-487c-807d-3bb8460f3a02" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Instance network_info: |[{"id": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "address": "fa:16:3e:78:d0:a7", "network": {"id": "dad71101-cc46-4510-bd10-70173e431b9f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-774900563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe51852d2e4213876d2bcba378c427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2f5c9-f7", "ovs_interfaceid": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-14232b79-50c1-4566-831d-7b708436aded req-a01360b7-2a30-4124-857a-d578d3fbb198 service nova] Acquired lock "refresh_cache-4e2d6eb9-c31e-487c-807d-3bb8460f3a02" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.network.neutron [req-14232b79-50c1-4566-831d-7b708436aded req-a01360b7-2a30-4124-857a-d578d3fbb198 service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Refreshing network info cache for port 72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Start _get_guest_xml network_info=[{"id": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "address": "fa:16:3e:78:d0:a7", "network": {"id": "dad71101-cc46-4510-bd10-70173e431b9f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-774900563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe51852d2e4213876d2bcba378c427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2f5c9-f7", "ovs_interfaceid": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:39:47 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:47 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2018062246',display_name='tempest-VolumesAssistedSnapshotsTest-server-2018062246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2018062246',id=10,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGbI5XPIj5z6tD/lSyhAEMQ0iacx2Ox1OOXcMUbwg8nG9WxAU7I62dVK5+ef9hQnQ214Q4P2hN5WmiV+aO1UX1J2F12sai4ecnn6o5ShQ28XYgZtOG0ii2O4E2YlmTdsQ==',key_name='tempest-keypair-1261404254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6fe51852d2e4213876d2bcba378c427',ramdisk_id='',reservation_id='r-ghrp2lf7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-695087630',owner_user_name='tempest-VolumesAssistedSnapshotsTest-695087630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3b20fdea3b44754b31ffb9baee27bbf',uuid=4e2d6eb9-c31e-487c-807d-3bb8460f3a02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "address": "fa:16:3e:78:d0:a7", "network": {"id": "dad71101-cc46-4510-bd10-70173e431b9f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-774900563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe51852d2e4213876d2bcba378c427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2f5c9-f7", "ovs_interfaceid": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Converting VIF {"id": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "address": "fa:16:3e:78:d0:a7", "network": {"id": "dad71101-cc46-4510-bd10-70173e431b9f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-774900563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe51852d2e4213876d2bcba378c427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2f5c9-f7", "ovs_interfaceid": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:d0:a7,bridge_name='br-int',has_traffic_filtering=True,id=72a2f5c9-f73f-4207-926b-8b82e845f8b3,network=Network(dad71101-cc46-4510-bd10-70173e431b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a2f5c9-f7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.objects.instance [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lazy-loading 'pci_devices' on Instance uuid 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] No VIF found with MAC fa:16:3e:e2:5d:c2, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:39:47 user nova-compute[75826]:   <uuid>4e2d6eb9-c31e-487c-807d-3bb8460f3a02</uuid>
Nov 16 00:39:47 user nova-compute[75826]:   <name>instance-0000000a</name>
Nov 16 00:39:47 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:39:47 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:39:47 user nova-compute[75826]:   <metadata>
Nov 16 00:39:47 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:39:47 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:39:47 user nova-compute[75826]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-2018062246</nova:name>
Nov 16 00:39:47 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:39:47</nova:creationTime>
Nov 16 00:39:47 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:39:47 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:39:47 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:39:47 user nova-compute[75826]:       <nova:owner>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:user uuid="f3b20fdea3b44754b31ffb9baee27bbf">tempest-VolumesAssistedSnapshotsTest-695087630-project-member</nova:user>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:project uuid="a6fe51852d2e4213876d2bcba378c427">tempest-VolumesAssistedSnapshotsTest-695087630</nova:project>
Nov 16 00:39:47 user nova-compute[75826]:       </nova:owner>
Nov 16 00:39:47 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:39:47 user nova-compute[75826]:       <nova:ports>
Nov 16 00:39:47 user nova-compute[75826]:         <nova:port uuid="72a2f5c9-f73f-4207-926b-8b82e845f8b3">
Nov 16 00:39:47 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 00:39:47 user nova-compute[75826]:         </nova:port>
Nov 16 00:39:47 user nova-compute[75826]:       </nova:ports>
Nov 16 00:39:47 user nova-compute[75826]:     </nova:instance>
Nov 16 00:39:47 user nova-compute[75826]:   </metadata>
Nov 16 00:39:47 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:39:47 user nova-compute[75826]:     <system>
Nov 16 00:39:47 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:39:47 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:39:47 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:39:47 user nova-compute[75826]:       <entry name="serial">4e2d6eb9-c31e-487c-807d-3bb8460f3a02</entry>
Nov 16 00:39:47 user nova-compute[75826]:       <entry name="uuid">4e2d6eb9-c31e-487c-807d-3bb8460f3a02</entry>
Nov 16 00:39:47 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:39:47 user nova-compute[75826]:     </system>
Nov 16 00:39:47 user nova-compute[75826]:   </sysinfo>
Nov 16 00:39:47 user nova-compute[75826]:   <os>
Nov 16 00:39:47 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:39:47 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:39:47 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:39:47 user nova-compute[75826]:   </os>
Nov 16 00:39:47 user nova-compute[75826]:   <features>
Nov 16 00:39:47 user nova-compute[75826]:     <acpi/>
Nov 16 00:39:47 user nova-compute[75826]:     <apic/>
Nov 16 00:39:47 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:39:47 user nova-compute[75826]:   </features>
Nov 16 00:39:47 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:39:47 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:39:47 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:39:47 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:39:47 user nova-compute[75826]:   </clock>
Nov 16 00:39:47 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:39:47 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:39:47 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:39:47 user nova-compute[75826]:   </cpu>
Nov 16 00:39:47 user nova-compute[75826]:   <devices>
Nov 16 00:39:47 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:39:47 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:39:47 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk"/>
Nov 16 00:39:47 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:39:47 user nova-compute[75826]:     </disk>
Nov 16 00:39:47 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:39:47 user nova-compute[75826]:       <mac address="fa:16:3e:78:d0:a7"/>
Nov 16 00:39:47 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:47 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:39:47 user nova-compute[75826]:       <target dev="tap72a2f5c9-f7"/>
Nov 16 00:39:47 user nova-compute[75826]:     </interface>
Nov 16 00:39:47 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:39:47 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/console.log" append="off"/>
Nov 16 00:39:47 user nova-compute[75826]:     </serial>
Nov 16 00:39:47 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:39:47 user nova-compute[75826]:     <video>
Nov 16 00:39:47 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:39:47 user nova-compute[75826]:     </video>
Nov 16 00:39:47 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:39:47 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:39:47 user nova-compute[75826]:     </rng>
Nov 16 00:39:47 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:39:47 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:39:47 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:39:47 user nova-compute[75826]:     </memballoon>
Nov 16 00:39:47 user nova-compute[75826]:   </devices>
Nov 16 00:39:47 user nova-compute[75826]: </domain>
Nov 16 00:39:47 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2018062246',display_name='tempest-VolumesAssistedSnapshotsTest-server-2018062246',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2018062246',id=10,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGbI5XPIj5z6tD/lSyhAEMQ0iacx2Ox1OOXcMUbwg8nG9WxAU7I62dVK5+ef9hQnQ214Q4P2hN5WmiV+aO1UX1J2F12sai4ecnn6o5ShQ28XYgZtOG0ii2O4E2YlmTdsQ==',key_name='tempest-keypair-1261404254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6fe51852d2e4213876d2bcba378c427',ramdisk_id='',reservation_id='r-ghrp2lf7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-695087630',owner_user_name='tempest-VolumesAssistedSnapshotsTest-695087630-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3b20fdea3b44754b31ffb9baee27bbf',uuid=4e2d6eb9-c31e-487c-807d-3bb8460f3a02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "address": "fa:16:3e:78:d0:a7", "network": {"id": "dad71101-cc46-4510-bd10-70173e431b9f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-774900563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe51852d2e4213876d2bcba378c427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2f5c9-f7", "ovs_interfaceid": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Converting VIF {"id": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "address": "fa:16:3e:78:d0:a7", "network": {"id": "dad71101-cc46-4510-bd10-70173e431b9f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-774900563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe51852d2e4213876d2bcba378c427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2f5c9-f7", "ovs_interfaceid": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:d0:a7,bridge_name='br-int',has_traffic_filtering=True,id=72a2f5c9-f73f-4207-926b-8b82e845f8b3,network=Network(dad71101-cc46-4510-bd10-70173e431b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a2f5c9-f7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG os_vif [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:d0:a7,bridge_name='br-int',has_traffic_filtering=True,id=72a2f5c9-f73f-4207-926b-8b82e845f8b3,network=Network(dad71101-cc46-4510-bd10-70173e431b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a2f5c9-f7') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '706fba4a-81d6-5723-bffb-d5dcc3466da6', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72a2f5c9-f7, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap72a2f5c9-f7, col_values=(('qos', UUID('67abd51b-7299-4c95-9c0e-cedc4c1cfdb2')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap72a2f5c9-f7, col_values=(('external_ids', {'iface-id': '72a2f5c9-f73f-4207-926b-8b82e845f8b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:d0:a7', 'vm-uuid': '4e2d6eb9-c31e-487c-807d-3bb8460f3a02'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:39:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:47 user nova-compute[75826]: INFO os_vif [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:d0:a7,bridge_name='br-int',has_traffic_filtering=True,id=72a2f5c9-f73f-4207-926b-8b82e845f8b3,network=Network(dad71101-cc46-4510-bd10-70173e431b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a2f5c9-f7')
Nov 16 00:39:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:39:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] No VIF found with MAC fa:16:3e:78:d0:a7, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:39:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-14232b79-50c1-4566-831d-7b708436aded req-a01360b7-2a30-4124-857a-d578d3fbb198 service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Updated VIF entry in instance network info cache for port 72a2f5c9-f73f-4207-926b-8b82e845f8b3. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:39:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-14232b79-50c1-4566-831d-7b708436aded req-a01360b7-2a30-4124-857a-d578d3fbb198 service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Updating instance_info_cache with network_info: [{"id": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "address": "fa:16:3e:78:d0:a7", "network": {"id": "dad71101-cc46-4510-bd10-70173e431b9f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-774900563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe51852d2e4213876d2bcba378c427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2f5c9-f7", "ovs_interfaceid": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:39:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-14232b79-50c1-4566-831d-7b708436aded req-a01360b7-2a30-4124-857a-d578d3fbb198 service nova] Releasing lock "refresh_cache-4e2d6eb9-c31e-487c-807d-3bb8460f3a02" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:39:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-1f36b5da-ffb7-4082-95cf-06ce0ba7d6e0 req-786265d7-0691-4c30-960b-b306873b9e4d service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-vif-plugged-ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1f36b5da-ffb7-4082-95cf-06ce0ba7d6e0 req-786265d7-0691-4c30-960b-b306873b9e4d service nova] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1f36b5da-ffb7-4082-95cf-06ce0ba7d6e0 req-786265d7-0691-4c30-960b-b306873b9e4d service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1f36b5da-ffb7-4082-95cf-06ce0ba7d6e0 req-786265d7-0691-4c30-960b-b306873b9e4d service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-1f36b5da-ffb7-4082-95cf-06ce0ba7d6e0 req-786265d7-0691-4c30-960b-b306873b9e4d service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] No waiting events found dispatching network-vif-plugged-ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:49 user nova-compute[75826]: WARNING nova.compute.manager [req-1f36b5da-ffb7-4082-95cf-06ce0ba7d6e0 req-786265d7-0691-4c30-960b-b306873b9e4d service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received unexpected event network-vif-plugged-ebabaf39-8f6c-4790-b555-271d5aef9db8 for instance with vm_state active and task_state None.
Nov 16 00:39:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-1f36b5da-ffb7-4082-95cf-06ce0ba7d6e0 req-786265d7-0691-4c30-960b-b306873b9e4d service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-vif-plugged-ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1f36b5da-ffb7-4082-95cf-06ce0ba7d6e0 req-786265d7-0691-4c30-960b-b306873b9e4d service nova] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1f36b5da-ffb7-4082-95cf-06ce0ba7d6e0 req-786265d7-0691-4c30-960b-b306873b9e4d service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1f36b5da-ffb7-4082-95cf-06ce0ba7d6e0 req-786265d7-0691-4c30-960b-b306873b9e4d service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-1f36b5da-ffb7-4082-95cf-06ce0ba7d6e0 req-786265d7-0691-4c30-960b-b306873b9e4d service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] No waiting events found dispatching network-vif-plugged-ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:49 user nova-compute[75826]: WARNING nova.compute.manager [req-1f36b5da-ffb7-4082-95cf-06ce0ba7d6e0 req-786265d7-0691-4c30-960b-b306873b9e4d service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received unexpected event network-vif-plugged-ebabaf39-8f6c-4790-b555-271d5aef9db8 for instance with vm_state active and task_state None.
Nov 16 00:39:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-d673b5c7-3090-4ec5-86f3-daf66d229091 req-65f9d2d4-374a-4239-a8cf-1eeb1b4c3c3b service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received event network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d673b5c7-3090-4ec5-86f3-daf66d229091 req-65f9d2d4-374a-4239-a8cf-1eeb1b4c3c3b service nova] Acquiring lock "33f2b149-1951-44d0-a65a-018316b31712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d673b5c7-3090-4ec5-86f3-daf66d229091 req-65f9d2d4-374a-4239-a8cf-1eeb1b4c3c3b service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d673b5c7-3090-4ec5-86f3-daf66d229091 req-65f9d2d4-374a-4239-a8cf-1eeb1b4c3c3b service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.015s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-d673b5c7-3090-4ec5-86f3-daf66d229091 req-65f9d2d4-374a-4239-a8cf-1eeb1b4c3c3b service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] No waiting events found dispatching network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:50 user nova-compute[75826]: WARNING nova.compute.manager [req-d673b5c7-3090-4ec5-86f3-daf66d229091 req-65f9d2d4-374a-4239-a8cf-1eeb1b4c3c3b service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received unexpected event network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 for instance with vm_state building and task_state spawning.
Nov 16 00:39:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-8c187612-802c-49af-aeaa-744cfb706e07 req-b682ab48-41df-42fa-8fbd-4edac063cb3c service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Received event network-vif-plugged-72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8c187612-802c-49af-aeaa-744cfb706e07 req-b682ab48-41df-42fa-8fbd-4edac063cb3c service nova] Acquiring lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8c187612-802c-49af-aeaa-744cfb706e07 req-b682ab48-41df-42fa-8fbd-4edac063cb3c service nova] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8c187612-802c-49af-aeaa-744cfb706e07 req-b682ab48-41df-42fa-8fbd-4edac063cb3c service nova] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.017s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-8c187612-802c-49af-aeaa-744cfb706e07 req-b682ab48-41df-42fa-8fbd-4edac063cb3c service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] No waiting events found dispatching network-vif-plugged-72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:51 user nova-compute[75826]: WARNING nova.compute.manager [req-8c187612-802c-49af-aeaa-744cfb706e07 req-b682ab48-41df-42fa-8fbd-4edac063cb3c service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Received unexpected event network-vif-plugged-72a2f5c9-f73f-4207-926b-8b82e845f8b3 for instance with vm_state building and task_state spawning.
Nov 16 00:39:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] There are 0 instances to clean {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75826) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG nova.compute.manager [req-f2b44572-4ab9-4fff-82fa-54cb2ed600ca req-efb0c9ae-9e1b-40b2-925d-efc2ecf1e899 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Received event network-vif-plugged-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f2b44572-4ab9-4fff-82fa-54cb2ed600ca req-efb0c9ae-9e1b-40b2-925d-efc2ecf1e899 service nova] Acquiring lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f2b44572-4ab9-4fff-82fa-54cb2ed600ca req-efb0c9ae-9e1b-40b2-925d-efc2ecf1e899 service nova] Lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f2b44572-4ab9-4fff-82fa-54cb2ed600ca req-efb0c9ae-9e1b-40b2-925d-efc2ecf1e899 service nova] Lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG nova.compute.manager [req-f2b44572-4ab9-4fff-82fa-54cb2ed600ca req-efb0c9ae-9e1b-40b2-925d-efc2ecf1e899 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] No waiting events found dispatching network-vif-plugged-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:52 user nova-compute[75826]: WARNING nova.compute.manager [req-f2b44572-4ab9-4fff-82fa-54cb2ed600ca req-efb0c9ae-9e1b-40b2-925d-efc2ecf1e899 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Received unexpected event network-vif-plugged-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 for instance with vm_state active and task_state None.
Nov 16 00:39:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-ee2e4015-ed98-4037-a4ae-4947a335c406 req-e7c55a80-c215-44f0-b6f9-fb88ffbd0c89 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received event network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ee2e4015-ed98-4037-a4ae-4947a335c406 req-e7c55a80-c215-44f0-b6f9-fb88ffbd0c89 service nova] Acquiring lock "33f2b149-1951-44d0-a65a-018316b31712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ee2e4015-ed98-4037-a4ae-4947a335c406 req-e7c55a80-c215-44f0-b6f9-fb88ffbd0c89 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ee2e4015-ed98-4037-a4ae-4947a335c406 req-e7c55a80-c215-44f0-b6f9-fb88ffbd0c89 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-ee2e4015-ed98-4037-a4ae-4947a335c406 req-e7c55a80-c215-44f0-b6f9-fb88ffbd0c89 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] No waiting events found dispatching network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:53 user nova-compute[75826]: WARNING nova.compute.manager [req-ee2e4015-ed98-4037-a4ae-4947a335c406 req-e7c55a80-c215-44f0-b6f9-fb88ffbd0c89 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received unexpected event network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 for instance with vm_state building and task_state spawning.
Nov 16 00:39:53 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-2937552b-aad2-4d8e-aee7-aa5a0daf64a8 req-d1be5b76-ccf6-4dc5-aa60-ce44c2b436c2 service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Received event network-vif-plugged-72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2937552b-aad2-4d8e-aee7-aa5a0daf64a8 req-d1be5b76-ccf6-4dc5-aa60-ce44c2b436c2 service nova] Acquiring lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2937552b-aad2-4d8e-aee7-aa5a0daf64a8 req-d1be5b76-ccf6-4dc5-aa60-ce44c2b436c2 service nova] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2937552b-aad2-4d8e-aee7-aa5a0daf64a8 req-d1be5b76-ccf6-4dc5-aa60-ce44c2b436c2 service nova] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-2937552b-aad2-4d8e-aee7-aa5a0daf64a8 req-d1be5b76-ccf6-4dc5-aa60-ce44c2b436c2 service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] No waiting events found dispatching network-vif-plugged-72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:53 user nova-compute[75826]: WARNING nova.compute.manager [req-2937552b-aad2-4d8e-aee7-aa5a0daf64a8 req-d1be5b76-ccf6-4dc5-aa60-ce44c2b436c2 service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Received unexpected event network-vif-plugged-72a2f5c9-f73f-4207-926b-8b82e845f8b3 for instance with vm_state building and task_state spawning.
Nov 16 00:39:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:39:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:39:53 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Instance spawned successfully.
Nov 16 00:39:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:54 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Instance spawned successfully.
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:39:54 user nova-compute[75826]: INFO nova.compute.claims [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Claim successful on node user
Nov 16 00:39:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:39:54 user nova-compute[75826]: INFO nova.compute.manager [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Took 8.25 seconds to spawn the instance on the hypervisor.
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:39:54 user nova-compute[75826]: INFO nova.compute.manager [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Took 9.27 seconds to spawn the instance on the hypervisor.
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:39:54 user nova-compute[75826]: INFO nova.compute.manager [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Took 10.36 seconds to build instance.
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-17644374-4920-4a2d-98f8-4f90c43b8511 req-7b4b477e-3c6c-4403-9eb3-f9532f74f0f4 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Received event network-vif-plugged-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-17644374-4920-4a2d-98f8-4f90c43b8511 req-7b4b477e-3c6c-4403-9eb3-f9532f74f0f4 service nova] Acquiring lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-17644374-4920-4a2d-98f8-4f90c43b8511 req-7b4b477e-3c6c-4403-9eb3-f9532f74f0f4 service nova] Lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-17644374-4920-4a2d-98f8-4f90c43b8511 req-7b4b477e-3c6c-4403-9eb3-f9532f74f0f4 service nova] Lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-17644374-4920-4a2d-98f8-4f90c43b8511 req-7b4b477e-3c6c-4403-9eb3-f9532f74f0f4 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] No waiting events found dispatching network-vif-plugged-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:39:54 user nova-compute[75826]: WARNING nova.compute.manager [req-17644374-4920-4a2d-98f8-4f90c43b8511 req-7b4b477e-3c6c-4403-9eb3-f9532f74f0f4 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Received unexpected event network-vif-plugged-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 for instance with vm_state active and task_state None.
Nov 16 00:39:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ef222dc-0b97-4188-ad92-2a99e95dc706 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.557s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:54 user nova-compute[75826]: INFO nova.compute.manager [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Took 22.89 seconds to build instance.
Nov 16 00:39:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-adbe7f56-b473-441c-a901-7ee4621d8c9d tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "33f2b149-1951-44d0-a65a-018316b31712" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.094s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.818s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.805s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:39:54 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:39:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:39:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:39:55 user nova-compute[75826]: INFO nova.virt.block_device [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Booting with volume bfd5899f-44e0-42bc-bd1d-b986c55a05bf at /dev/vda
Nov 16 00:39:55 user nova-compute[75826]: DEBUG nova.policy [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29260c50829242a5b55e6e7971d937de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7e78195df3b4c788437c1b99f9d12ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG os_brick.utils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb90de8-8a62-472b-813e-bca9c40354bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.041s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[558910dd-c57e-44ff-9edc-0f41d5e36402]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[19211250-45e5-4c84-8805-61da3bf76822]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[544515d2-107a-41fc-8cdb-b8e6446d698e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:39:55 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9b818d-7d1a-4bd4-aac9-bf4cd13478be]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG os_brick.utils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] <== get_connector_properties: return (240ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating existing volume attachment record: 51be1b45-e621-4524-ab45-68057de2d8b7 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:56 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Successfully created port: 84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:57 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Successfully created port: 3b998d5a-b393-40c4-aeaf-864d935daafb {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:57 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Successfully created port: e2489a9a-e276-4520-8812-f00178685319 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:58 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Successfully created port: a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:39:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:39:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:59 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Successfully created port: 6dcf7900-9048-4817-bd83-53eac2e701f9 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:39:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:39:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:39:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:00 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Successfully updated port: 84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:40:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-8a2c3e4c-a203-4b92-ae1b-ef2faa776349 req-bcf15e21-a8fc-4963-afeb-d0de4129b387 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-changed-84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-8a2c3e4c-a203-4b92-ae1b-ef2faa776349 req-bcf15e21-a8fc-4963-afeb-d0de4129b387 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing instance network info cache due to event network-changed-84598159-131b-4f3b-8bee-97257e504831. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:40:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8a2c3e4c-a203-4b92-ae1b-ef2faa776349 req-bcf15e21-a8fc-4963-afeb-d0de4129b387 service nova] Acquiring lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:40:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8a2c3e4c-a203-4b92-ae1b-ef2faa776349 req-bcf15e21-a8fc-4963-afeb-d0de4129b387 service nova] Acquired lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:40:00 user nova-compute[75826]: DEBUG nova.network.neutron [req-8a2c3e4c-a203-4b92-ae1b-ef2faa776349 req-bcf15e21-a8fc-4963-afeb-d0de4129b387 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing network info cache for port 84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:40:00 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:40:00 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:40:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7426MB free_disk=25.83234405517578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:40:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:00 user nova-compute[75826]: DEBUG nova.network.neutron [req-8a2c3e4c-a203-4b92-ae1b-ef2faa776349 req-bcf15e21-a8fc-4963-afeb-d0de4129b387 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.network.neutron [req-8a2c3e4c-a203-4b92-ae1b-ef2faa776349 req-bcf15e21-a8fc-4963-afeb-d0de4129b387 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8a2c3e4c-a203-4b92-ae1b-ef2faa776349 req-bcf15e21-a8fc-4963-afeb-d0de4129b387 service nova] Releasing lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ee7b37f1-ac3b-4257-b463-790b3d19770d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance d9ac6719-80f7-490a-a51e-869b51118aa2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance e9c58516-5dba-49b0-b94d-119adbbe8529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 8946e093-6440-479f-95bc-c65391b9d2ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 33f2b149-1951-44d0-a65a-018316b31712 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing inventories for resource provider 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating ProviderTree inventory for provider 015246d3-5250-41ea-8943-b837ba3f5938 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating inventory in ProviderTree for provider 015246d3-5250-41ea-8943-b837ba3f5938 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing aggregate associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, aggregates: None {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing trait associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Successfully updated port: 3eb287a3-094b-4525-abd4-e60c8078ba61 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:40:01 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.207s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:02 user nova-compute[75826]: INFO nova.virt.block_device [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Booting with volume e0fc7afe-aebe-48c1-b550-3af8eacea432 at /dev/vdb
Nov 16 00:40:02 user nova-compute[75826]: DEBUG os_brick.utils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-dd37a317-3538-4105-ae29-6380c627f587 req-6d2dd7f1-755f-4455-9175-0d59b70e3ce5 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-changed-3eb287a3-094b-4525-abd4-e60c8078ba61 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-dd37a317-3538-4105-ae29-6380c627f587 req-6d2dd7f1-755f-4455-9175-0d59b70e3ce5 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing instance network info cache due to event network-changed-3eb287a3-094b-4525-abd4-e60c8078ba61. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dd37a317-3538-4105-ae29-6380c627f587 req-6d2dd7f1-755f-4455-9175-0d59b70e3ce5 service nova] Acquiring lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dd37a317-3538-4105-ae29-6380c627f587 req-6d2dd7f1-755f-4455-9175-0d59b70e3ce5 service nova] Acquired lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG nova.network.neutron [req-dd37a317-3538-4105-ae29-6380c627f587 req-6d2dd7f1-755f-4455-9175-0d59b70e3ce5 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing network info cache for port 3eb287a3-094b-4525-abd4-e60c8078ba61 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f94906-bfcb-45a1-9a34-37655d1c2df8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4600f4e9-17b0-4e7a-acc7-9d93851e444f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e270723-a321-4b82-995f-084b154339e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a567b71f-9ef3-403d-b501-ab446e4f13c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Successfully updated port: 8c765ac0-c657-4339-bd26-a7e5156efc55 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG nova.network.neutron [req-dd37a317-3538-4105-ae29-6380c627f587 req-6d2dd7f1-755f-4455-9175-0d59b70e3ce5 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:40:02 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe544125-5f09-4c35-986f-77fed27841c7]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG os_brick.utils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating existing volume attachment record: d77301b7-2cbb-4872-8812-29d2b99b83db {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG nova.network.neutron [req-dd37a317-3538-4105-ae29-6380c627f587 req-6d2dd7f1-755f-4455-9175-0d59b70e3ce5 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dd37a317-3538-4105-ae29-6380c627f587 req-6d2dd7f1-755f-4455-9175-0d59b70e3ce5 service nova] Releasing lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Successfully updated port: 3b998d5a-b393-40c4-aeaf-864d935daafb {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:40:02 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Skipping network cache update for instance because it is Building. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-ee7b37f1-ac3b-4257-b463-790b3d19770d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-ee7b37f1-ac3b-4257-b463-790b3d19770d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG nova.objects.instance [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lazy-loading 'info_cache' on Instance uuid ee7b37f1-ac3b-4257-b463-790b3d19770d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Successfully updated port: e2489a9a-e276-4520-8812-f00178685319 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Updating instance_info_cache with network_info: [{"id": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "address": "fa:16:3e:8b:4f:c6", "network": {"id": "7559216a-146b-4292-b08c-8efd725fe35a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-657857206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b3993c3a5c4fb386c82befaa7e0bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0640d9b5-ce", "ovs_interfaceid": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-ee7b37f1-ac3b-4257-b463-790b3d19770d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:40:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Successfully updated port: a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-changed-8c765ac0-c657-4339-bd26-a7e5156efc55 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing instance network info cache due to event network-changed-8c765ac0-c657-4339-bd26-a7e5156efc55. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] Acquiring lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] Acquired lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.network.neutron [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing network info cache for port 8c765ac0-c657-4339-bd26-a7e5156efc55 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.network.neutron [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.network.neutron [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] Releasing lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-changed-3b998d5a-b393-40c4-aeaf-864d935daafb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing instance network info cache due to event network-changed-3b998d5a-b393-40c4-aeaf-864d935daafb. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] Acquiring lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] Acquired lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.network.neutron [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing network info cache for port 3b998d5a-b393-40c4-aeaf-864d935daafb {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.network.neutron [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.network.neutron [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] Releasing lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-changed-e2489a9a-e276-4520-8812-f00178685319 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing instance network info cache due to event network-changed-e2489a9a-e276-4520-8812-f00178685319. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] Acquiring lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] Acquired lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:40:04 user nova-compute[75826]: DEBUG nova.network.neutron [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing network info cache for port e2489a9a-e276-4520-8812-f00178685319 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:40:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Successfully updated port: 6dcf7900-9048-4817-bd83-53eac2e701f9 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:40:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:40:05 user nova-compute[75826]: DEBUG nova.network.neutron [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:40:05 user nova-compute[75826]: DEBUG nova.network.neutron [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:40:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-966d1a2c-619b-486f-90ad-213bceeebde6 req-bd8b2218-a464-4d35-a773-f263b4434fd9 service nova] Releasing lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:40:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquired lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:40:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:40:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:40:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-changed-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing instance network info cache due to event network-changed-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:40:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] Acquiring lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:40:07 user nova-compute[75826]: DEBUG nova.network.neutron [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [{"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b998d5a-b393-40c4-aeaf-864d935daafb", "address": "fa:16:3e:7d:48:21", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b998d5a-b3", "ovs_interfaceid": "3b998d5a-b393-40c4-aeaf-864d935daafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2489a9a-e276-4520-8812-f00178685319", "address": "fa:16:3e:d6:6e:db", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2489a9a-e2", "ovs_interfaceid": "e2489a9a-e276-4520-8812-f00178685319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:40:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Releasing lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:40:07 user nova-compute[75826]: DEBUG nova.compute.manager [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Instance network_info: |[{"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b998d5a-b393-40c4-aeaf-864d935daafb", "address": "fa:16:3e:7d:48:21", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b998d5a-b3", "ovs_interfaceid": "3b998d5a-b393-40c4-aeaf-864d935daafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2489a9a-e276-4520-8812-f00178685319", "address": "fa:16:3e:d6:6e:db", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2489a9a-e2", "ovs_interfaceid": "e2489a9a-e276-4520-8812-f00178685319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:40:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] Acquired lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:40:07 user nova-compute[75826]: DEBUG nova.network.neutron [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing network info cache for port a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:40:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:07 user nova-compute[75826]: DEBUG nova.network.neutron [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updated VIF entry in instance network info cache for port a5bcc1ad-78d3-4302-beca-f4e4a27dfc59. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:40:07 user nova-compute[75826]: DEBUG nova.network.neutron [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [{"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b998d5a-b393-40c4-aeaf-864d935daafb", "address": "fa:16:3e:7d:48:21", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b998d5a-b3", "ovs_interfaceid": "3b998d5a-b393-40c4-aeaf-864d935daafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2489a9a-e276-4520-8812-f00178685319", "address": "fa:16:3e:d6:6e:db", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2489a9a-e2", "ovs_interfaceid": "e2489a9a-e276-4520-8812-f00178685319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] Releasing lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG nova.compute.manager [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-changed-6dcf7900-9048-4817-bd83-53eac2e701f9 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG nova.compute.manager [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing instance network info cache due to event network-changed-6dcf7900-9048-4817-bd83-53eac2e701f9. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] Acquiring lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] Acquired lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG nova.network.neutron [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing network info cache for port 6dcf7900-9048-4817-bd83-53eac2e701f9 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:40:08 user nova-compute[75826]: INFO nova.virt.block_device [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Booting with volume 8c82fa9f-c996-4bc7-9cf5-82f93f579e9c at /dev/vdc
Nov 16 00:40:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG nova.network.neutron [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updated VIF entry in instance network info cache for port 6dcf7900-9048-4817-bd83-53eac2e701f9. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG nova.network.neutron [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [{"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b998d5a-b393-40c4-aeaf-864d935daafb", "address": "fa:16:3e:7d:48:21", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b998d5a-b3", "ovs_interfaceid": "3b998d5a-b393-40c4-aeaf-864d935daafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2489a9a-e276-4520-8812-f00178685319", "address": "fa:16:3e:d6:6e:db", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2489a9a-e2", "ovs_interfaceid": "e2489a9a-e276-4520-8812-f00178685319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0b9e677b-2191-46d0-ad6f-248586139ac5 req-b282dc0d-cccb-44e3-8a3e-4f56b656cc8a service nova] Releasing lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG os_brick.utils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7166be-b94e-4b8f-901e-ed77c0574bc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[958d3c66-12c9-42f1-a058-808db6d60e42]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7760fb-d3be-4add-8fa8-b3f0f3a75ef7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3289c0d1-ac4e-42a2-a549-2da67f1e0274]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:40:08 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:40:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbf4f4d-421d-46ec-bfbe-8fbcf6c68f43]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG os_brick.utils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:40:08 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating existing volume attachment record: 27169792-2a77-469b-935b-4305292a0ca9 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:40:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:40:14 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Creating image(s)
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Ensure instance console log exists: /opt/stack/data/nova/instances/4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Start _get_guest_xml network_info=[{"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b998d5a-b393-40c4-aeaf-864d935daafb", "address": "fa:16:3e:7d:48:21", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b998d5a-b3", "ovs_interfaceid": "3b998d5a-b393-40c4-aeaf-864d935daafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2489a9a-e276-4520-8812-f00178685319", "address": "fa:16:3e:d6:6e:db", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2489a9a-e2", "ovs_interfaceid": "e2489a9a-e276-4520-8812-f00178685319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '51be1b45-e621-4524-ab45-68057de2d8b7', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZenvdFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d', 'attached_at': '', 'detached_at': '', 'volume_id': 'bfd5899f-44e0-42bc-bd1d-b986c55a05bf', 'serial': 'bfd5899f-44e0-42bc-bd1d-b986c55a05bf'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': 'd77301b7-2cbb-4872-8812-29d2b99b83db', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVzwNjTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0fc7afe-aebe-48c1-b550-3af8eacea432', 'serial': 'e0fc7afe-aebe-48c1-b550-3af8eacea432'}, 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': '27169792-2a77-469b-935b-4305292a0ca9', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANJyzeVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d', 'attached_at': '', 'detached_at': '', 'volume_id': '8c82fa9f-c996-4bc7-9cf5-82f93f579e9c', 'serial': '8c82fa9f-c996-4bc7-9cf5-82f93f579e9c'}, 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:40:14 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:40:14 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZenvdFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:40:14 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:40:14 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:40:14 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c5eac8-f6d5-4406-b386-f3705f716b6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:40:14 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6890d409-e518-4d27-bb16-4724050b1f21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf] added
Nov 16 00:40:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f17924-f5e9-4a12-84a5-99f8bb916dc5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cd0e0a-62ca-4daa-b454-4a01a7d54c80]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZenvdFB {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uZenvdFB" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3a8859-94b6-42e5-8e56-30f6707d9cbf]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uZenvdFB'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa5bd65-4668-4d05-8448-cb597f841534]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[623bc4e1-d848-4b73-bbac-8894b5aa9750]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:40:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:40:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2ae22c-fa7c-4482-80b0-12ed8a423cb1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf, portal: 172.16.0.220,3260]
Nov 16 00:40:14 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf, portal: 172.16.0.220,3260] successful.
Nov 16 00:40:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2445215d-7a79-4ea2-8eae-2deaa1560a57]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb6adfe-27a4-4fc8-b48f-69baabcad075]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:40:14 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:40:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:40:14 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:40:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b787de1-48de-4a90-8b6e-704bb8d9796f]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:14 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZenvdFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '26638343137386332', 'path': '/dev/sdc'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638343137386332', 'path': '/dev/sdc'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVzwNjTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:40:15 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:40:15 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:40:15 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c782d99d-5dac-4d78-82a9-9364a5510809]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:40:15 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[420d1996-2594-4172-97a9-bc91dd82025b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432] added
Nov 16 00:40:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[85add7a8-9730-490d-8d6e-aac1027bb991]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cdbbbd-62ae-4db8-8aab-1f687ffcf84e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVzwNjTW {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sVzwNjTW" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[291c0bb5-de95-4d52-ae2a-9a86c5ddea42]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sVzwNjTW'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b574311a-7998-4131-8edd-910ae645ef1c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1436adc9-1ed6-459e-a18b-8878c6cf59d2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:40:15 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:40:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:40:15 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:40:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2b038b-0425-46cd-9e4b-9ad4b7f0346d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432, portal: 172.16.0.220,3260]
Nov 16 00:40:15 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432, portal: 172.16.0.220,3260] successful.
Nov 16 00:40:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c74612-47c5-4f42-b9fe-58c5dd2cf875]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ace1d1b-e6a0-4371-9aab-24995358e664]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:40:15 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:40:15 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:40:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:40:15 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:40:15 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:40:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25b54e6-c741-44e5-ab3d-63bd4c3daa40]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:40:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVzwNjTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:40:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:40:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23564333562323232', 'path': '/dev/sdd'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:40:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564333562323232', 'path': '/dev/sdd'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANJyzeVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:40:17 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:40:17 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:40:17 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed8497c-5ff7-4b80-ae76-e9e0ea73cae7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:40:17 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e07219c-e17e-4f4e-9379-a8f1de396ff8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c] added
Nov 16 00:40:17 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[963f8c09-e3f6-4211-9fd4-9f7b982ab061]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7141f6ba-0bd8-43e0-91dd-39cb727fadb9]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANJyzeVY {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ANJyzeVY" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4946980-c47b-435f-917d-49c5f6f63b19]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ANJyzeVY'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a3187ac-ac23-42d7-b54c-740e44695be2]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[30126b85-3cf1-4efb-9dab-bfa07164a3fb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:40:17 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:40:17 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:40:17 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:40:17 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:40:17 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:40:17 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[896796ba-4153-4e83-ad8c-19766fce68e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c, portal: 172.16.0.220,3260]
Nov 16 00:40:17 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c, portal: 172.16.0.220,3260] successful.
Nov 16 00:40:17 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fabd29f-8fd5-458c-a13b-5dbbdd4664c9]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1c6228-1985-48de-ab3c-99a6b4a33d98]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:40:17 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:40:17 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:40:17 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:40:17 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:40:17 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:40:17 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:40:17 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:40:17 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1786088f-0621-4ff4-ba45-380000513556]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANJyzeVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:40:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '26665386230386161', 'path': '/dev/sde'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665386230386161', 'path': '/dev/sde'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:26:8e,bridge_name='br-int',has_traffic_filtering=True,id=84598159-131b-4f3b-8bee-97257e504831,network=Network(df29f611-0f85-46dd-b62c-d751f6aca045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84598159-13') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:72:11,bridge_name='br-int',has_traffic_filtering=True,id=3eb287a3-094b-4525-abd4-e60c8078ba61,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3eb287a3-09') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:17:e1,bridge_name='br-int',has_traffic_filtering=True,id=8c765ac0-c657-4339-bd26-a7e5156efc55,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c765ac0-c6') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b998d5a-b393-40c4-aeaf-864d935daafb", "address": "fa:16:3e:7d:48:21", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b998d5a-b3", "ovs_interfaceid": "3b998d5a-b393-40c4-aeaf-864d935daafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "3b998d5a-b393-40c4-aeaf-864d935daafb", "address": "fa:16:3e:7d:48:21", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b998d5a-b3", "ovs_interfaceid": "3b998d5a-b393-40c4-aeaf-864d935daafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:48:21,bridge_name='br-int',has_traffic_filtering=True,id=3b998d5a-b393-40c4-aeaf-864d935daafb,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b998d5a-b3') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2489a9a-e276-4520-8812-f00178685319", "address": "fa:16:3e:d6:6e:db", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2489a9a-e2", "ovs_interfaceid": "e2489a9a-e276-4520-8812-f00178685319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "e2489a9a-e276-4520-8812-f00178685319", "address": "fa:16:3e:d6:6e:db", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2489a9a-e2", "ovs_interfaceid": "e2489a9a-e276-4520-8812-f00178685319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:db,bridge_name='br-int',has_traffic_filtering=True,id=e2489a9a-e276-4520-8812-f00178685319,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2489a9a-e2') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:88:66,bridge_name='br-int',has_traffic_filtering=True,id=a5bcc1ad-78d3-4302-beca-f4e4a27dfc59,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bcc1ad-78') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=6dcf7900-9048-4817-bd83-53eac2e701f9,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcf7900-90') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.objects.instance [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:40:18 user nova-compute[75826]:   <uuid>4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d</uuid>
Nov 16 00:40:18 user nova-compute[75826]:   <name>instance-0000000b</name>
Nov 16 00:40:18 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:40:18 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:40:18 user nova-compute[75826]:   <metadata>
Nov 16 00:40:18 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:40:18 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:40:18 user nova-compute[75826]:       <nova:name>tempest-device-tagging-server-1291003582</nova:name>
Nov 16 00:40:18 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:40:14</nova:creationTime>
Nov 16 00:40:18 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:40:18 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:40:18 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:40:18 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:40:18 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:40:18 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:40:18 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:40:18 user nova-compute[75826]:       <nova:owner>
Nov 16 00:40:18 user nova-compute[75826]:         <nova:user uuid="29260c50829242a5b55e6e7971d937de">tempest-TaggedBootDevicesTest_v242-1758002120-project-member</nova:user>
Nov 16 00:40:18 user nova-compute[75826]:         <nova:project uuid="d7e78195df3b4c788437c1b99f9d12ce">tempest-TaggedBootDevicesTest_v242-1758002120</nova:project>
Nov 16 00:40:18 user nova-compute[75826]:       </nova:owner>
Nov 16 00:40:18 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:40:18 user nova-compute[75826]:       <nova:ports>
Nov 16 00:40:18 user nova-compute[75826]:         <nova:port uuid="84598159-131b-4f3b-8bee-97257e504831">
Nov 16 00:40:18 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 00:40:18 user nova-compute[75826]:         </nova:port>
Nov 16 00:40:18 user nova-compute[75826]:         <nova:port uuid="3eb287a3-094b-4525-abd4-e60c8078ba61">
Nov 16 00:40:18 user nova-compute[75826]:           <nova:ip type="fixed" address="10.1.1.102" ipVersion="4"/>
Nov 16 00:40:18 user nova-compute[75826]:         </nova:port>
Nov 16 00:40:18 user nova-compute[75826]:         <nova:port uuid="8c765ac0-c657-4339-bd26-a7e5156efc55">
Nov 16 00:40:18 user nova-compute[75826]:           <nova:ip type="fixed" address="10.1.1.104" ipVersion="4"/>
Nov 16 00:40:18 user nova-compute[75826]:         </nova:port>
Nov 16 00:40:18 user nova-compute[75826]:         <nova:port uuid="3b998d5a-b393-40c4-aeaf-864d935daafb">
Nov 16 00:40:18 user nova-compute[75826]:           <nova:ip type="fixed" address="10.1.1.144" ipVersion="4"/>
Nov 16 00:40:18 user nova-compute[75826]:         </nova:port>
Nov 16 00:40:18 user nova-compute[75826]:         <nova:port uuid="e2489a9a-e276-4520-8812-f00178685319">
Nov 16 00:40:18 user nova-compute[75826]:           <nova:ip type="fixed" address="10.1.1.23" ipVersion="4"/>
Nov 16 00:40:18 user nova-compute[75826]:         </nova:port>
Nov 16 00:40:18 user nova-compute[75826]:         <nova:port uuid="a5bcc1ad-78d3-4302-beca-f4e4a27dfc59">
Nov 16 00:40:18 user nova-compute[75826]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 00:40:18 user nova-compute[75826]:         </nova:port>
Nov 16 00:40:18 user nova-compute[75826]:         <nova:port uuid="6dcf7900-9048-4817-bd83-53eac2e701f9">
Nov 16 00:40:18 user nova-compute[75826]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 00:40:18 user nova-compute[75826]:         </nova:port>
Nov 16 00:40:18 user nova-compute[75826]:       </nova:ports>
Nov 16 00:40:18 user nova-compute[75826]:     </nova:instance>
Nov 16 00:40:18 user nova-compute[75826]:   </metadata>
Nov 16 00:40:18 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:40:18 user nova-compute[75826]:     <system>
Nov 16 00:40:18 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:40:18 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:40:18 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:40:18 user nova-compute[75826]:       <entry name="serial">4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d</entry>
Nov 16 00:40:18 user nova-compute[75826]:       <entry name="uuid">4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d</entry>
Nov 16 00:40:18 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:40:18 user nova-compute[75826]:     </system>
Nov 16 00:40:18 user nova-compute[75826]:   </sysinfo>
Nov 16 00:40:18 user nova-compute[75826]:   <os>
Nov 16 00:40:18 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:40:18 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:40:18 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:40:18 user nova-compute[75826]:   </os>
Nov 16 00:40:18 user nova-compute[75826]:   <features>
Nov 16 00:40:18 user nova-compute[75826]:     <acpi/>
Nov 16 00:40:18 user nova-compute[75826]:     <apic/>
Nov 16 00:40:18 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:40:18 user nova-compute[75826]:   </features>
Nov 16 00:40:18 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:40:18 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:40:18 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:40:18 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:40:18 user nova-compute[75826]:   </clock>
Nov 16 00:40:18 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:40:18 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:40:18 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:40:18 user nova-compute[75826]:   </cpu>
Nov 16 00:40:18 user nova-compute[75826]:   <devices>
Nov 16 00:40:18 user nova-compute[75826]:     <disk type="file" device="cdrom">
Nov 16 00:40:18 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 00:40:18 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d/disk.config"/>
Nov 16 00:40:18 user nova-compute[75826]:       <target dev="hda" bus="ide"/>
Nov 16 00:40:18 user nova-compute[75826]:     </disk>
Nov 16 00:40:18 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:40:18 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:40:18 user nova-compute[75826]:       <source dev="/dev/sdc"/>
Nov 16 00:40:18 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:40:18 user nova-compute[75826]:       <serial>bfd5899f-44e0-42bc-bd1d-b986c55a05bf</serial>
Nov 16 00:40:18 user nova-compute[75826]:     </disk>
Nov 16 00:40:18 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:40:18 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:40:18 user nova-compute[75826]:       <source dev="/dev/sdd"/>
Nov 16 00:40:18 user nova-compute[75826]:       <target dev="vdb" bus="virtio"/>
Nov 16 00:40:18 user nova-compute[75826]:       <serial>e0fc7afe-aebe-48c1-b550-3af8eacea432</serial>
Nov 16 00:40:18 user nova-compute[75826]:     </disk>
Nov 16 00:40:18 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:40:18 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:40:18 user nova-compute[75826]:       <source dev="/dev/sde"/>
Nov 16 00:40:18 user nova-compute[75826]:       <target dev="vdc" bus="virtio"/>
Nov 16 00:40:18 user nova-compute[75826]:       <serial>8c82fa9f-c996-4bc7-9cf5-82f93f579e9c</serial>
Nov 16 00:40:18 user nova-compute[75826]:     </disk>
Nov 16 00:40:18 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:40:18 user nova-compute[75826]:       <mac address="fa:16:3e:28:26:8e"/>
Nov 16 00:40:18 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:40:18 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:40:18 user nova-compute[75826]:       <target dev="tap84598159-13"/>
Nov 16 00:40:18 user nova-compute[75826]:     </interface>
Nov 16 00:40:18 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:40:18 user nova-compute[75826]:       <mac address="fa:16:3e:1f:72:11"/>
Nov 16 00:40:18 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:40:18 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:40:18 user nova-compute[75826]:       <target dev="tap3eb287a3-09"/>
Nov 16 00:40:18 user nova-compute[75826]:     </interface>
Nov 16 00:40:18 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:40:18 user nova-compute[75826]:       <mac address="fa:16:3e:db:17:e1"/>
Nov 16 00:40:18 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:40:18 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:40:18 user nova-compute[75826]:       <target dev="tap8c765ac0-c6"/>
Nov 16 00:40:18 user nova-compute[75826]:     </interface>
Nov 16 00:40:18 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:40:18 user nova-compute[75826]:       <mac address="fa:16:3e:7d:48:21"/>
Nov 16 00:40:18 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:40:18 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:40:18 user nova-compute[75826]:       <target dev="tap3b998d5a-b3"/>
Nov 16 00:40:18 user nova-compute[75826]:     </interface>
Nov 16 00:40:18 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:40:18 user nova-compute[75826]:       <mac address="fa:16:3e:d6:6e:db"/>
Nov 16 00:40:18 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:40:18 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:40:18 user nova-compute[75826]:       <target dev="tape2489a9a-e2"/>
Nov 16 00:40:18 user nova-compute[75826]:     </interface>
Nov 16 00:40:18 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:40:18 user nova-compute[75826]:       <mac address="fa:16:3e:37:88:66"/>
Nov 16 00:40:18 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:40:18 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:40:18 user nova-compute[75826]:       <target dev="tapa5bcc1ad-78"/>
Nov 16 00:40:18 user nova-compute[75826]:     </interface>
Nov 16 00:40:18 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:40:18 user nova-compute[75826]:       <mac address="fa:16:3e:ba:05:a2"/>
Nov 16 00:40:18 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:40:18 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:40:18 user nova-compute[75826]:       <target dev="tap6dcf7900-90"/>
Nov 16 00:40:18 user nova-compute[75826]:     </interface>
Nov 16 00:40:18 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:40:18 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d/console.log" append="off"/>
Nov 16 00:40:18 user nova-compute[75826]:     </serial>
Nov 16 00:40:18 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:40:18 user nova-compute[75826]:     <video>
Nov 16 00:40:18 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:40:18 user nova-compute[75826]:     </video>
Nov 16 00:40:18 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:40:18 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:40:18 user nova-compute[75826]:     </rng>
Nov 16 00:40:18 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:40:18 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:40:18 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:40:18 user nova-compute[75826]:     </memballoon>
Nov 16 00:40:18 user nova-compute[75826]:   </devices>
Nov 16 00:40:18 user nova-compute[75826]: </domain>
Nov 16 00:40:18 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:26:8e,bridge_name='br-int',has_traffic_filtering=True,id=84598159-131b-4f3b-8bee-97257e504831,network=Network(df29f611-0f85-46dd-b62c-d751f6aca045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84598159-13') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:26:8e,bridge_name='br-int',has_traffic_filtering=True,id=84598159-131b-4f3b-8bee-97257e504831,network=Network(df29f611-0f85-46dd-b62c-d751f6aca045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84598159-13') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79066e0b-2a3a-54ba-86a0-cc0fcc47e43f', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84598159-13, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84598159-13, col_values=(('qos', UUID('c2869ea8-042a-49c4-9957-16102064b16f')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84598159-13, col_values=(('external_ids', {'iface-id': '84598159-131b-4f3b-8bee-97257e504831', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:26:8e', 'vm-uuid': '4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: INFO os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:26:8e,bridge_name='br-int',has_traffic_filtering=True,id=84598159-131b-4f3b-8bee-97257e504831,network=Network(df29f611-0f85-46dd-b62c-d751f6aca045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84598159-13')
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:72:11,bridge_name='br-int',has_traffic_filtering=True,id=3eb287a3-094b-4525-abd4-e60c8078ba61,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3eb287a3-09') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:72:11,bridge_name='br-int',has_traffic_filtering=True,id=3eb287a3-094b-4525-abd4-e60c8078ba61,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3eb287a3-09') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0db428ea-7525-504f-9dd0-c4224e876b4e', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3eb287a3-09, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3eb287a3-09, col_values=(('qos', UUID('c469ccc0-4e87-431a-b0c5-e3bc38e8437c')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3eb287a3-09, col_values=(('external_ids', {'iface-id': '3eb287a3-094b-4525-abd4-e60c8078ba61', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:72:11', 'vm-uuid': '4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: INFO os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:72:11,bridge_name='br-int',has_traffic_filtering=True,id=3eb287a3-094b-4525-abd4-e60c8078ba61,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3eb287a3-09')
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:17:e1,bridge_name='br-int',has_traffic_filtering=True,id=8c765ac0-c657-4339-bd26-a7e5156efc55,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c765ac0-c6') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:17:e1,bridge_name='br-int',has_traffic_filtering=True,id=8c765ac0-c657-4339-bd26-a7e5156efc55,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c765ac0-c6') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a47bcc61-c494-56ac-a719-2d7391fe1421', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c765ac0-c6, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8c765ac0-c6, col_values=(('qos', UUID('0cdc89bc-bfe7-40ed-bc00-3a58cb2040cf')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8c765ac0-c6, col_values=(('external_ids', {'iface-id': '8c765ac0-c657-4339-bd26-a7e5156efc55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:17:e1', 'vm-uuid': '4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: INFO os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:17:e1,bridge_name='br-int',has_traffic_filtering=True,id=8c765ac0-c657-4339-bd26-a7e5156efc55,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c765ac0-c6')
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b998d5a-b393-40c4-aeaf-864d935daafb", "address": "fa:16:3e:7d:48:21", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b998d5a-b3", "ovs_interfaceid": "3b998d5a-b393-40c4-aeaf-864d935daafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "3b998d5a-b393-40c4-aeaf-864d935daafb", "address": "fa:16:3e:7d:48:21", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b998d5a-b3", "ovs_interfaceid": "3b998d5a-b393-40c4-aeaf-864d935daafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:48:21,bridge_name='br-int',has_traffic_filtering=True,id=3b998d5a-b393-40c4-aeaf-864d935daafb,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b998d5a-b3') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:48:21,bridge_name='br-int',has_traffic_filtering=True,id=3b998d5a-b393-40c4-aeaf-864d935daafb,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b998d5a-b3') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1d3c3a0e-2ebf-538a-8a28-850c461dd180', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b998d5a-b3, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b998d5a-b3, col_values=(('qos', UUID('b8935de3-8c4b-498c-a5e1-03492ccf8bdc')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b998d5a-b3, col_values=(('external_ids', {'iface-id': '3b998d5a-b393-40c4-aeaf-864d935daafb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:48:21', 'vm-uuid': '4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: INFO os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:48:21,bridge_name='br-int',has_traffic_filtering=True,id=3b998d5a-b393-40c4-aeaf-864d935daafb,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b998d5a-b3')
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2489a9a-e276-4520-8812-f00178685319", "address": "fa:16:3e:d6:6e:db", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2489a9a-e2", "ovs_interfaceid": "e2489a9a-e276-4520-8812-f00178685319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "e2489a9a-e276-4520-8812-f00178685319", "address": "fa:16:3e:d6:6e:db", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2489a9a-e2", "ovs_interfaceid": "e2489a9a-e276-4520-8812-f00178685319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:db,bridge_name='br-int',has_traffic_filtering=True,id=e2489a9a-e276-4520-8812-f00178685319,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2489a9a-e2') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:db,bridge_name='br-int',has_traffic_filtering=True,id=e2489a9a-e276-4520-8812-f00178685319,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2489a9a-e2') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0323b464-bf80-5de2-808b-8287e67532f7', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2489a9a-e2, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2489a9a-e2, col_values=(('qos', UUID('c1a940a8-7dc4-4bf1-811f-424a190cd53f')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2489a9a-e2, col_values=(('external_ids', {'iface-id': 'e2489a9a-e276-4520-8812-f00178685319', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:6e:db', 'vm-uuid': '4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: INFO os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:db,bridge_name='br-int',has_traffic_filtering=True,id=e2489a9a-e276-4520-8812-f00178685319,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2489a9a-e2')
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:88:66,bridge_name='br-int',has_traffic_filtering=True,id=a5bcc1ad-78d3-4302-beca-f4e4a27dfc59,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bcc1ad-78') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:88:66,bridge_name='br-int',has_traffic_filtering=True,id=a5bcc1ad-78d3-4302-beca-f4e4a27dfc59,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bcc1ad-78') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '104b9e72-50ec-5052-9ce2-cbea08cfe6d4', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5bcc1ad-78, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5bcc1ad-78, col_values=(('qos', UUID('2406dab8-36b5-4a5a-9fd0-de8c00bbd9ec')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5bcc1ad-78, col_values=(('external_ids', {'iface-id': 'a5bcc1ad-78d3-4302-beca-f4e4a27dfc59', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:88:66', 'vm-uuid': '4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: INFO os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:88:66,bridge_name='br-int',has_traffic_filtering=True,id=a5bcc1ad-78d3-4302-beca-f4e4a27dfc59,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bcc1ad-78')
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=6dcf7900-9048-4817-bd83-53eac2e701f9,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcf7900-90') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=6dcf7900-9048-4817-bd83-53eac2e701f9,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcf7900-90') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfd183f0-fef8-5e03-8a82-66ba7d86a20a', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6dcf7900-90, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6dcf7900-90, col_values=(('qos', UUID('ee90004b-6a1c-49a3-bb28-3ce56c74a145')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6dcf7900-90, col_values=(('external_ids', {'iface-id': '6dcf7900-9048-4817-bd83-53eac2e701f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:05:a2', 'vm-uuid': '4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:19 user nova-compute[75826]: INFO os_vif [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=6dcf7900-9048-4817-bd83-53eac2e701f9,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcf7900-90')
Nov 16 00:40:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] No BDM found with device name hda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:40:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:40:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] No VIF found with MAC fa:16:3e:28:26:8e, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:40:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] No VIF found with MAC fa:16:3e:d6:6e:db, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:40:19 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Using config drive
Nov 16 00:40:19 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Creating config drive at /opt/stack/data/nova/instances/4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d/disk.config
Nov 16 00:40:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpigoe68pw {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpigoe68pw" returned: 0 in 0.067s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-823f0a5a-5b11-4467-a8da-01150aaf5cc3 req-48b8f451-a0ca-4dad-b028-7d4adadd3a47 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-823f0a5a-5b11-4467-a8da-01150aaf5cc3 req-48b8f451-a0ca-4dad-b028-7d4adadd3a47 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-823f0a5a-5b11-4467-a8da-01150aaf5cc3 req-48b8f451-a0ca-4dad-b028-7d4adadd3a47 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-823f0a5a-5b11-4467-a8da-01150aaf5cc3 req-48b8f451-a0ca-4dad-b028-7d4adadd3a47 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-823f0a5a-5b11-4467-a8da-01150aaf5cc3 req-48b8f451-a0ca-4dad-b028-7d4adadd3a47 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:21 user nova-compute[75826]: WARNING nova.compute.manager [req-823f0a5a-5b11-4467-a8da-01150aaf5cc3 req-48b8f451-a0ca-4dad-b028-7d4adadd3a47 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-84598159-131b-4f3b-8bee-97257e504831 for instance with vm_state building and task_state spawning.
Nov 16 00:40:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-b73ab2cc-c2db-4d15-9295-6854550836a8 req-535af71b-78fe-4a58-b7a8-f715940390b6 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-8c765ac0-c657-4339-bd26-a7e5156efc55 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b73ab2cc-c2db-4d15-9295-6854550836a8 req-535af71b-78fe-4a58-b7a8-f715940390b6 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b73ab2cc-c2db-4d15-9295-6854550836a8 req-535af71b-78fe-4a58-b7a8-f715940390b6 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b73ab2cc-c2db-4d15-9295-6854550836a8 req-535af71b-78fe-4a58-b7a8-f715940390b6 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-b73ab2cc-c2db-4d15-9295-6854550836a8 req-535af71b-78fe-4a58-b7a8-f715940390b6 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-8c765ac0-c657-4339-bd26-a7e5156efc55 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:21 user nova-compute[75826]: WARNING nova.compute.manager [req-b73ab2cc-c2db-4d15-9295-6854550836a8 req-535af71b-78fe-4a58-b7a8-f715940390b6 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-8c765ac0-c657-4339-bd26-a7e5156efc55 for instance with vm_state building and task_state spawning.
Nov 16 00:40:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:23 user nova-compute[75826]: WARNING nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-84598159-131b-4f3b-8bee-97257e504831 for instance with vm_state building and task_state spawning.
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-3eb287a3-094b-4525-abd4-e60c8078ba61 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-3eb287a3-094b-4525-abd4-e60c8078ba61 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:23 user nova-compute[75826]: WARNING nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-3eb287a3-094b-4525-abd4-e60c8078ba61 for instance with vm_state building and task_state spawning.
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-3eb287a3-094b-4525-abd4-e60c8078ba61 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-3eb287a3-094b-4525-abd4-e60c8078ba61 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:23 user nova-compute[75826]: WARNING nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-3eb287a3-094b-4525-abd4-e60c8078ba61 for instance with vm_state building and task_state spawning.
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-e2489a9a-e276-4520-8812-f00178685319 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-e2489a9a-e276-4520-8812-f00178685319 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:23 user nova-compute[75826]: WARNING nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-e2489a9a-e276-4520-8812-f00178685319 for instance with vm_state building and task_state spawning.
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-e2489a9a-e276-4520-8812-f00178685319 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-e2489a9a-e276-4520-8812-f00178685319 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:23 user nova-compute[75826]: WARNING nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-e2489a9a-e276-4520-8812-f00178685319 for instance with vm_state building and task_state spawning.
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:23 user nova-compute[75826]: WARNING nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 for instance with vm_state building and task_state spawning.
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:23 user nova-compute[75826]: WARNING nova.compute.manager [req-9e66e0d8-6d82-4c6b-a995-d49188a5faf7 req-06fff95d-4e3a-483e-9328-8b57415580f9 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 for instance with vm_state building and task_state spawning.
Nov 16 00:40:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-8c765ac0-c657-4339-bd26-a7e5156efc55 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-8c765ac0-c657-4339-bd26-a7e5156efc55 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:23 user nova-compute[75826]: WARNING nova.compute.manager [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-8c765ac0-c657-4339-bd26-a7e5156efc55 for instance with vm_state building and task_state spawning.
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-3b998d5a-b393-40c4-aeaf-864d935daafb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-3b998d5a-b393-40c4-aeaf-864d935daafb {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:23 user nova-compute[75826]: WARNING nova.compute.manager [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-3b998d5a-b393-40c4-aeaf-864d935daafb for instance with vm_state building and task_state spawning.
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-3b998d5a-b393-40c4-aeaf-864d935daafb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-3b998d5a-b393-40c4-aeaf-864d935daafb {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:23 user nova-compute[75826]: WARNING nova.compute.manager [req-6b8e0868-2789-40b8-b0c1-e668c27b080d req-0869b898-17db-407b-9f93-14b48bf51078 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-3b998d5a-b393-40c4-aeaf-864d935daafb for instance with vm_state building and task_state spawning.
Nov 16 00:40:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:40:25 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Instance spawned successfully.
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:40:25 user nova-compute[75826]: INFO nova.compute.manager [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Took 10.83 seconds to spawn the instance on the hypervisor.
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-e71d18e7-b42d-4e3e-b831-c3ff8067d0d7 req-37d24f7d-d86b-41df-90aa-eddeb8df598f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-6dcf7900-9048-4817-bd83-53eac2e701f9 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e71d18e7-b42d-4e3e-b831-c3ff8067d0d7 req-37d24f7d-d86b-41df-90aa-eddeb8df598f service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e71d18e7-b42d-4e3e-b831-c3ff8067d0d7 req-37d24f7d-d86b-41df-90aa-eddeb8df598f service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e71d18e7-b42d-4e3e-b831-c3ff8067d0d7 req-37d24f7d-d86b-41df-90aa-eddeb8df598f service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-e71d18e7-b42d-4e3e-b831-c3ff8067d0d7 req-37d24f7d-d86b-41df-90aa-eddeb8df598f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-6dcf7900-9048-4817-bd83-53eac2e701f9 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:25 user nova-compute[75826]: WARNING nova.compute.manager [req-e71d18e7-b42d-4e3e-b831-c3ff8067d0d7 req-37d24f7d-d86b-41df-90aa-eddeb8df598f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-6dcf7900-9048-4817-bd83-53eac2e701f9 for instance with vm_state building and task_state spawning.
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-e71d18e7-b42d-4e3e-b831-c3ff8067d0d7 req-37d24f7d-d86b-41df-90aa-eddeb8df598f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-6dcf7900-9048-4817-bd83-53eac2e701f9 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e71d18e7-b42d-4e3e-b831-c3ff8067d0d7 req-37d24f7d-d86b-41df-90aa-eddeb8df598f service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e71d18e7-b42d-4e3e-b831-c3ff8067d0d7 req-37d24f7d-d86b-41df-90aa-eddeb8df598f service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e71d18e7-b42d-4e3e-b831-c3ff8067d0d7 req-37d24f7d-d86b-41df-90aa-eddeb8df598f service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-e71d18e7-b42d-4e3e-b831-c3ff8067d0d7 req-37d24f7d-d86b-41df-90aa-eddeb8df598f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-6dcf7900-9048-4817-bd83-53eac2e701f9 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:25 user nova-compute[75826]: WARNING nova.compute.manager [req-e71d18e7-b42d-4e3e-b831-c3ff8067d0d7 req-37d24f7d-d86b-41df-90aa-eddeb8df598f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-6dcf7900-9048-4817-bd83-53eac2e701f9 for instance with vm_state building and task_state spawning.
Nov 16 00:40:25 user nova-compute[75826]: INFO nova.compute.manager [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Took 31.23 seconds to build instance.
Nov 16 00:40:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db44af39-9f76-4043-82f0-e8a1ec02c8b3 tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.343s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:40:42 user nova-compute[75826]: INFO nova.compute.claims [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Claim successful on node user
Nov 16 00:40:42 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.487s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:40:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:40:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG nova.policy [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5562a4fee0d14187bcb346ba5a4634af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151c8475c39a472b9f99d7b94752e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:40:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Creating image(s)
Nov 16 00:40:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "/opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "/opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.219s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk 1073741824" returned: 0 in 0.059s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Successfully created port: 236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.582s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:40:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Cannot resize image /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Ensure instance console log exists: /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Successfully updated port: 236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "refresh_cache-1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquired lock "refresh_cache-1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-c868161e-9565-4b94-8fd4-fd346d703e02 req-7138c279-715d-4ba5-9f7a-7f60c50153c9 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Received event network-changed-236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-c868161e-9565-4b94-8fd4-fd346d703e02 req-7138c279-715d-4ba5-9f7a-7f60c50153c9 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Refreshing instance network info cache due to event network-changed-236b01b5-75c3-44de-9672-6fc73939c4a0. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c868161e-9565-4b94-8fd4-fd346d703e02 req-7138c279-715d-4ba5-9f7a-7f60c50153c9 service nova] Acquiring lock "refresh_cache-1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Updating instance_info_cache with network_info: [{"id": "236b01b5-75c3-44de-9672-6fc73939c4a0", "address": "fa:16:3e:b4:52:8d", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236b01b5-75", "ovs_interfaceid": "236b01b5-75c3-44de-9672-6fc73939c4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Releasing lock "refresh_cache-1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Instance network_info: |[{"id": "236b01b5-75c3-44de-9672-6fc73939c4a0", "address": "fa:16:3e:b4:52:8d", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236b01b5-75", "ovs_interfaceid": "236b01b5-75c3-44de-9672-6fc73939c4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c868161e-9565-4b94-8fd4-fd346d703e02 req-7138c279-715d-4ba5-9f7a-7f60c50153c9 service nova] Acquired lock "refresh_cache-1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-c868161e-9565-4b94-8fd4-fd346d703e02 req-7138c279-715d-4ba5-9f7a-7f60c50153c9 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Refreshing network info cache for port 236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Start _get_guest_xml network_info=[{"id": "236b01b5-75c3-44de-9672-6fc73939c4a0", "address": "fa:16:3e:b4:52:8d", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236b01b5-75", "ovs_interfaceid": "236b01b5-75c3-44de-9672-6fc73939c4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:40:44 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:40:44 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1624888409',display_name='tempest-TestStampPattern-server-1624888409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1624888409',id=12,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnVOKXX9r1n1SeXR18FAZ5ReiXMg6r0YfIpLL5KrVybqfFaIfm7SGvy2MKiB0irAegI0W1yk67LwVXLx0F4yvrQoFAmD1fY1rcoS5KnlcevqtmC0fE4TYt7AS0e05sCcw==',key_name='tempest-TestStampPattern-2032325257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='151c8475c39a472b9f99d7b94752e148',ramdisk_id='',reservation_id='r-ezr44zjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1037297845',owner_user_name='tempest-TestStampPattern-1037297845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:40:43Z,user_data=None,user_id='5562a4fee0d14187bcb346ba5a4634af',uuid=1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "236b01b5-75c3-44de-9672-6fc73939c4a0", "address": "fa:16:3e:b4:52:8d", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236b01b5-75", "ovs_interfaceid": "236b01b5-75c3-44de-9672-6fc73939c4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Converting VIF {"id": "236b01b5-75c3-44de-9672-6fc73939c4a0", "address": "fa:16:3e:b4:52:8d", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236b01b5-75", "ovs_interfaceid": "236b01b5-75c3-44de-9672-6fc73939c4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=236b01b5-75c3-44de-9672-6fc73939c4a0,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236b01b5-75') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.objects.instance [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:40:44 user nova-compute[75826]:   <uuid>1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25</uuid>
Nov 16 00:40:44 user nova-compute[75826]:   <name>instance-0000000c</name>
Nov 16 00:40:44 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:40:44 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:40:44 user nova-compute[75826]:   <metadata>
Nov 16 00:40:44 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:40:44 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:40:44 user nova-compute[75826]:       <nova:name>tempest-TestStampPattern-server-1624888409</nova:name>
Nov 16 00:40:44 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:40:44</nova:creationTime>
Nov 16 00:40:44 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:40:44 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:40:44 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:40:44 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:40:44 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:40:44 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:40:44 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:40:44 user nova-compute[75826]:       <nova:owner>
Nov 16 00:40:44 user nova-compute[75826]:         <nova:user uuid="5562a4fee0d14187bcb346ba5a4634af">tempest-TestStampPattern-1037297845-project-member</nova:user>
Nov 16 00:40:44 user nova-compute[75826]:         <nova:project uuid="151c8475c39a472b9f99d7b94752e148">tempest-TestStampPattern-1037297845</nova:project>
Nov 16 00:40:44 user nova-compute[75826]:       </nova:owner>
Nov 16 00:40:44 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:40:44 user nova-compute[75826]:       <nova:ports>
Nov 16 00:40:44 user nova-compute[75826]:         <nova:port uuid="236b01b5-75c3-44de-9672-6fc73939c4a0">
Nov 16 00:40:44 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 00:40:44 user nova-compute[75826]:         </nova:port>
Nov 16 00:40:44 user nova-compute[75826]:       </nova:ports>
Nov 16 00:40:44 user nova-compute[75826]:     </nova:instance>
Nov 16 00:40:44 user nova-compute[75826]:   </metadata>
Nov 16 00:40:44 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:40:44 user nova-compute[75826]:     <system>
Nov 16 00:40:44 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:40:44 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:40:44 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:40:44 user nova-compute[75826]:       <entry name="serial">1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25</entry>
Nov 16 00:40:44 user nova-compute[75826]:       <entry name="uuid">1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25</entry>
Nov 16 00:40:44 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:40:44 user nova-compute[75826]:     </system>
Nov 16 00:40:44 user nova-compute[75826]:   </sysinfo>
Nov 16 00:40:44 user nova-compute[75826]:   <os>
Nov 16 00:40:44 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:40:44 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:40:44 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:40:44 user nova-compute[75826]:   </os>
Nov 16 00:40:44 user nova-compute[75826]:   <features>
Nov 16 00:40:44 user nova-compute[75826]:     <acpi/>
Nov 16 00:40:44 user nova-compute[75826]:     <apic/>
Nov 16 00:40:44 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:40:44 user nova-compute[75826]:   </features>
Nov 16 00:40:44 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:40:44 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:40:44 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:40:44 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:40:44 user nova-compute[75826]:   </clock>
Nov 16 00:40:44 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:40:44 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:40:44 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:40:44 user nova-compute[75826]:   </cpu>
Nov 16 00:40:44 user nova-compute[75826]:   <devices>
Nov 16 00:40:44 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:40:44 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:40:44 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk"/>
Nov 16 00:40:44 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:40:44 user nova-compute[75826]:     </disk>
Nov 16 00:40:44 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:40:44 user nova-compute[75826]:       <mac address="fa:16:3e:b4:52:8d"/>
Nov 16 00:40:44 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:40:44 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:40:44 user nova-compute[75826]:       <target dev="tap236b01b5-75"/>
Nov 16 00:40:44 user nova-compute[75826]:     </interface>
Nov 16 00:40:44 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:40:44 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/console.log" append="off"/>
Nov 16 00:40:44 user nova-compute[75826]:     </serial>
Nov 16 00:40:44 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:40:44 user nova-compute[75826]:     <video>
Nov 16 00:40:44 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:40:44 user nova-compute[75826]:     </video>
Nov 16 00:40:44 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:40:44 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:40:44 user nova-compute[75826]:     </rng>
Nov 16 00:40:44 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:40:44 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:40:44 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:40:44 user nova-compute[75826]:     </memballoon>
Nov 16 00:40:44 user nova-compute[75826]:   </devices>
Nov 16 00:40:44 user nova-compute[75826]: </domain>
Nov 16 00:40:44 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1624888409',display_name='tempest-TestStampPattern-server-1624888409',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1624888409',id=12,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnVOKXX9r1n1SeXR18FAZ5ReiXMg6r0YfIpLL5KrVybqfFaIfm7SGvy2MKiB0irAegI0W1yk67LwVXLx0F4yvrQoFAmD1fY1rcoS5KnlcevqtmC0fE4TYt7AS0e05sCcw==',key_name='tempest-TestStampPattern-2032325257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='151c8475c39a472b9f99d7b94752e148',ramdisk_id='',reservation_id='r-ezr44zjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1037297845',owner_user_name='tempest-TestStampPattern-1037297845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:40:43Z,user_data=None,user_id='5562a4fee0d14187bcb346ba5a4634af',uuid=1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "236b01b5-75c3-44de-9672-6fc73939c4a0", "address": "fa:16:3e:b4:52:8d", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236b01b5-75", "ovs_interfaceid": "236b01b5-75c3-44de-9672-6fc73939c4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Converting VIF {"id": "236b01b5-75c3-44de-9672-6fc73939c4a0", "address": "fa:16:3e:b4:52:8d", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236b01b5-75", "ovs_interfaceid": "236b01b5-75c3-44de-9672-6fc73939c4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=236b01b5-75c3-44de-9672-6fc73939c4a0,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236b01b5-75') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG os_vif [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=236b01b5-75c3-44de-9672-6fc73939c4a0,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236b01b5-75') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7636ecff-93fe-57c4-a341-90c6838fc2d9', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap236b01b5-75, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap236b01b5-75, col_values=(('qos', UUID('a51f223e-8ce2-4dc9-bd6e-967da9cbe945')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap236b01b5-75, col_values=(('external_ids', {'iface-id': '236b01b5-75c3-44de-9672-6fc73939c4a0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:52:8d', 'vm-uuid': '1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:44 user nova-compute[75826]: INFO os_vif [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=236b01b5-75c3-44de-9672-6fc73939c4a0,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236b01b5-75')
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:40:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] No VIF found with MAC fa:16:3e:b4:52:8d, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:40:45 user nova-compute[75826]: DEBUG nova.network.neutron [req-c868161e-9565-4b94-8fd4-fd346d703e02 req-7138c279-715d-4ba5-9f7a-7f60c50153c9 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Updated VIF entry in instance network info cache for port 236b01b5-75c3-44de-9672-6fc73939c4a0. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:40:45 user nova-compute[75826]: DEBUG nova.network.neutron [req-c868161e-9565-4b94-8fd4-fd346d703e02 req-7138c279-715d-4ba5-9f7a-7f60c50153c9 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Updating instance_info_cache with network_info: [{"id": "236b01b5-75c3-44de-9672-6fc73939c4a0", "address": "fa:16:3e:b4:52:8d", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236b01b5-75", "ovs_interfaceid": "236b01b5-75c3-44de-9672-6fc73939c4a0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:40:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c868161e-9565-4b94-8fd4-fd346d703e02 req-7138c279-715d-4ba5-9f7a-7f60c50153c9 service nova] Releasing lock "refresh_cache-1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:40:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-50ef8d30-e2e0-4516-8cbf-8c4400f72732 req-9e9940eb-095f-4461-bc14-1ca5d7328566 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Received event network-vif-plugged-236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-50ef8d30-e2e0-4516-8cbf-8c4400f72732 req-9e9940eb-095f-4461-bc14-1ca5d7328566 service nova] Acquiring lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-50ef8d30-e2e0-4516-8cbf-8c4400f72732 req-9e9940eb-095f-4461-bc14-1ca5d7328566 service nova] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-50ef8d30-e2e0-4516-8cbf-8c4400f72732 req-9e9940eb-095f-4461-bc14-1ca5d7328566 service nova] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-50ef8d30-e2e0-4516-8cbf-8c4400f72732 req-9e9940eb-095f-4461-bc14-1ca5d7328566 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] No waiting events found dispatching network-vif-plugged-236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:46 user nova-compute[75826]: WARNING nova.compute.manager [req-50ef8d30-e2e0-4516-8cbf-8c4400f72732 req-9e9940eb-095f-4461-bc14-1ca5d7328566 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Received unexpected event network-vif-plugged-236b01b5-75c3-44de-9672-6fc73939c4a0 for instance with vm_state building and task_state spawning.
Nov 16 00:40:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:48 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:40:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:40:48 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Instance spawned successfully.
Nov 16 00:40:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:40:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:40:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:40:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:40:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:40:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:40:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:40:48 user nova-compute[75826]: INFO nova.compute.manager [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Took 5.73 seconds to spawn the instance on the hypervisor.
Nov 16 00:40:48 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:40:48 user nova-compute[75826]: INFO nova.compute.manager [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Took 6.55 seconds to build instance.
Nov 16 00:40:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3e14a776-e006-4354-9ee0-85d48b51fad8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.684s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-fb5d458a-e02e-443e-895a-3f281ec00a22 req-d3fa427a-3db3-4eac-958f-bbac7b74960d service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Received event network-vif-plugged-236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fb5d458a-e02e-443e-895a-3f281ec00a22 req-d3fa427a-3db3-4eac-958f-bbac7b74960d service nova] Acquiring lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fb5d458a-e02e-443e-895a-3f281ec00a22 req-d3fa427a-3db3-4eac-958f-bbac7b74960d service nova] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fb5d458a-e02e-443e-895a-3f281ec00a22 req-d3fa427a-3db3-4eac-958f-bbac7b74960d service nova] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-fb5d458a-e02e-443e-895a-3f281ec00a22 req-d3fa427a-3db3-4eac-958f-bbac7b74960d service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] No waiting events found dispatching network-vif-plugged-236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:40:48 user nova-compute[75826]: WARNING nova.compute.manager [req-fb5d458a-e02e-443e-895a-3f281ec00a22 req-d3fa427a-3db3-4eac-958f-bbac7b74960d service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Received unexpected event network-vif-plugged-236b01b5-75c3-44de-9672-6fc73939c4a0 for instance with vm_state active and task_state None.
Nov 16 00:40:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:52 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "ee7b37f1-ac3b-4257-b463-790b3d19770d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG nova.objects.instance [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lazy-loading 'flavor' on Instance uuid ee7b37f1-ac3b-4257-b463-790b3d19770d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.139s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "ee7b37f1-ac3b-4257-b463-790b3d19770d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:53 user nova-compute[75826]: INFO nova.compute.manager [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Attaching volume a2181e80-5191-4ab5-8456-9e124be94be0 to /dev/vdb
Nov 16 00:40:53 user nova-compute[75826]: DEBUG os_brick.utils [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6c5758-e91e-46a5-b211-dd6502a18c23]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99fd66f-a549-4983-91a0-4fa3deefcd41]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd9d014-b03b-4494-93bc-4e97d1d8ca58]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a73e312-1a49-4834-97a5-ce78ccc4c8b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:40:54 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9f729d-5a0e-4302-81cf-09a9850fe889]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG os_brick.utils [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Updating existing volume attachment record: b72e217a-00bb-4a54-b157-1def91e87251 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:40:54 user nova-compute[75826]: INFO nova.compute.manager [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] instance snapshotting
Nov 16 00:40:54 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Beginning live snapshot process
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json -f qcow2 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json -f qcow2 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.261s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5yi4d1c_/d042d01ae36741d29be7e71fc8d3fe00.delta 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp5yi4d1c_/d042d01ae36741d29be7e71fc8d3fe00.delta 1073741824" returned: 0 in 0.078s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 00:40:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75826) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 16 00:40:55 user nova-compute[75826]: INFO nova.virt.libvirt.host [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] UEFI support detected
Nov 16 00:40:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-ea44b145-ff30-4f2f-882d-c63943abf701 req-0de2813a-98a7-4812-b0a2-3799fb0daa02 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Received event network-changed-95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-ea44b145-ff30-4f2f-882d-c63943abf701 req-0de2813a-98a7-4812-b0a2-3799fb0daa02 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Refreshing instance network info cache due to event network-changed-95244a55-3c22-4eb7-ada5-7c20002f8728. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:40:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ea44b145-ff30-4f2f-882d-c63943abf701 req-0de2813a-98a7-4812-b0a2-3799fb0daa02 service nova] Acquiring lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:40:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ea44b145-ff30-4f2f-882d-c63943abf701 req-0de2813a-98a7-4812-b0a2-3799fb0daa02 service nova] Acquired lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:40:55 user nova-compute[75826]: DEBUG nova.network.neutron [req-ea44b145-ff30-4f2f-882d-c63943abf701 req-0de2813a-98a7-4812-b0a2-3799fb0daa02 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Refreshing network info cache for port 95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:40:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-ea44b145-ff30-4f2f-882d-c63943abf701 req-0de2813a-98a7-4812-b0a2-3799fb0daa02 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updated VIF entry in instance network info cache for port 95244a55-3c22-4eb7-ada5-7c20002f8728. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-ea44b145-ff30-4f2f-882d-c63943abf701 req-0de2813a-98a7-4812-b0a2-3799fb0daa02 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updating instance_info_cache with network_info: [{"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ea44b145-ff30-4f2f-882d-c63943abf701 req-0de2813a-98a7-4812-b0a2-3799fb0daa02 service nova] Releasing lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] COPY block job progress, current cursor: 40435712 final cursor: 75497472 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:40:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 00:40:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:57 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:40:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5yi4d1c_/d042d01ae36741d29be7e71fc8d3fe00.delta /opt/stack/data/nova/instances/snapshots/tmp5yi4d1c_/d042d01ae36741d29be7e71fc8d3fe00 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp5yi4d1c_/d042d01ae36741d29be7e71fc8d3fe00.delta /opt/stack/data/nova/instances/snapshots/tmp5yi4d1c_/d042d01ae36741d29be7e71fc8d3fe00" returned: 0 in 0.409s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Snapshot extracted, beginning image upload
Nov 16 00:40:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:40:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-3e0bf3e1-6fd3-4f27-968a-d1dd561d2219 req-efd64735-7d2e-4c9d-aed8-20d9d5394128 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-changed-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-3e0bf3e1-6fd3-4f27-968a-d1dd561d2219 req-efd64735-7d2e-4c9d-aed8-20d9d5394128 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Refreshing instance network info cache due to event network-changed-7cb43f66-87cf-4cac-85ab-abfe01ff82cc. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3e0bf3e1-6fd3-4f27-968a-d1dd561d2219 req-efd64735-7d2e-4c9d-aed8-20d9d5394128 service nova] Acquiring lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3e0bf3e1-6fd3-4f27-968a-d1dd561d2219 req-efd64735-7d2e-4c9d-aed8-20d9d5394128 service nova] Acquired lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.network.neutron [req-3e0bf3e1-6fd3-4f27-968a-d1dd561d2219 req-efd64735-7d2e-4c9d-aed8-20d9d5394128 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Refreshing network info cache for port 7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zkHKFXtG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:40:59 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:40:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:40:59 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:40:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:40:59 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:59 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:40:59 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=6755MB free_disk=25.677841186523438GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1e49d0-2a2c-47d7-8027-04a283a263b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:40:59 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c33cdf-b544-4103-8f30-6561921ce691]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0] added
Nov 16 00:40:59 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabbb957-f271-46a1-a373-e8ccd2a2302e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b461d26d-c128-4db2-be15-f6d43448dca5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zkHKFXtG {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zkHKFXtG" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[48613f11-c022-4236-9622-4f73f879926c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zkHKFXtG'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ee7b37f1-ac3b-4257-b463-790b3d19770d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance d9ac6719-80f7-490a-a51e-869b51118aa2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance e9c58516-5dba-49b0-b94d-119adbbe8529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 8946e093-6440-479f-95bc-c65391b9d2ba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 33f2b149-1951-44d0-a65a-018316b31712 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9958d88-3cf6-45ba-bf8e-ae553d248e27]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:40:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9803d2-f927-48e7-b803-6cbd1e22347d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db2606c-85ac-43ab-8dcc-d103aaf45cee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0, portal: 172.16.0.220,3260]
Nov 16 00:41:00 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3720cd-9a18-4547-97d9-afa3dcf526a8]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8839d6-df7d-4c06-8076-f12d25a282ba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 (non-flash)
Nov 16 00:41:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:00 user nova-compute[75826]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 (non-flash)
Nov 16 00:41:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.043s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86f53bc-8ef9-4aae-86dc-1cabbbcd8001]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zkHKFXtG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG nova.network.neutron [req-3e0bf3e1-6fd3-4f27-968a-d1dd561d2219 req-efd64735-7d2e-4c9d-aed8-20d9d5394128 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updated VIF entry in instance network info cache for port 7cb43f66-87cf-4cac-85ab-abfe01ff82cc. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG nova.network.neutron [req-3e0bf3e1-6fd3-4f27-968a-d1dd561d2219 req-efd64735-7d2e-4c9d-aed8-20d9d5394128 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating instance_info_cache with network_info: [{"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3e0bf3e1-6fd3-4f27-968a-d1dd561d2219 req-efd64735-7d2e-4c9d-aed8-20d9d5394128 service nova] Releasing lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:41:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.806s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:00 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Snapshot image upload complete
Nov 16 00:41:00 user nova-compute[75826]: INFO nova.compute.manager [None req-7815b29f-cd5f-489e-b980-fad41630fa24 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Took 6.50 seconds to snapshot the instance on the hypervisor.
Nov 16 00:41:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '26135646163373738', 'path': '/dev/sdf'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135646163373738', 'path': '/dev/sdf'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG nova.objects.instance [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lazy-loading 'flavor' on Instance uuid ee7b37f1-ac3b-4257-b463-790b3d19770d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:41:01 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:01 user nova-compute[75826]:   <source dev="/dev/sdf"/>
Nov 16 00:41:01 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:41:01 user nova-compute[75826]:   <serial>a2181e80-5191-4ab5-8456-9e124be94be0</serial>
Nov 16 00:41:01 user nova-compute[75826]: </disk>
Nov 16 00:41:01 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] No VIF found with MAC fa:16:3e:8b:4f:c6, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:41:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-67ad44fb-aed7-47c5-af0f-2d90a6e46a94 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.101s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:02 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Updating instance_info_cache with network_info: [{"id": "378f1586-075a-47fc-8723-540896093fe4", "address": "fa:16:3e:7d:d3:79", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378f1586-07", "ovs_interfaceid": "378f1586-075a-47fc-8723-540896093fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:41:02 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:41:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:41:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:41:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:41:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:41:02 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:41:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "ee7b37f1-ac3b-4257-b463-790b3d19770d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:03 user nova-compute[75826]: INFO nova.compute.manager [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Terminating instance
Nov 16 00:41:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-42a55e4a-a5e2-418d-8bcd-f25ba5c67ccc req-a2c75477-eb5f-4c06-ab5a-588b9eca5eed service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Received event network-vif-unplugged-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-42a55e4a-a5e2-418d-8bcd-f25ba5c67ccc req-a2c75477-eb5f-4c06-ab5a-588b9eca5eed service nova] Acquiring lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-42a55e4a-a5e2-418d-8bcd-f25ba5c67ccc req-a2c75477-eb5f-4c06-ab5a-588b9eca5eed service nova] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-42a55e4a-a5e2-418d-8bcd-f25ba5c67ccc req-a2c75477-eb5f-4c06-ab5a-588b9eca5eed service nova] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-42a55e4a-a5e2-418d-8bcd-f25ba5c67ccc req-a2c75477-eb5f-4c06-ab5a-588b9eca5eed service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] No waiting events found dispatching network-vif-unplugged-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-42a55e4a-a5e2-418d-8bcd-f25ba5c67ccc req-a2c75477-eb5f-4c06-ab5a-588b9eca5eed service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Received event network-vif-unplugged-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:41:03 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Instance destroyed successfully.
Nov 16 00:41:03 user nova-compute[75826]: DEBUG nova.objects.instance [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lazy-loading 'resources' on Instance uuid ee7b37f1-ac3b-4257-b463-790b3d19770d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1790925052',display_name='tempest-DeleteServersTestJSON-server-1790925052',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1790925052',id=1,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='68b3993c3a5c4fb386c82befaa7e0bf4',ramdisk_id='',reservation_id='r-7624q1ye',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-658187176',owner_user_name='tempest-DeleteServersTestJSON-658187176-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:39:21Z,user_data=None,user_id='c2826fd168ac4b49bf5295da2b21219a',uuid=ee7b37f1-ac3b-4257-b463-790b3d19770d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "address": "fa:16:3e:8b:4f:c6", "network": {"id": "7559216a-146b-4292-b08c-8efd725fe35a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-657857206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b3993c3a5c4fb386c82befaa7e0bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0640d9b5-ce", "ovs_interfaceid": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Converting VIF {"id": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "address": "fa:16:3e:8b:4f:c6", "network": {"id": "7559216a-146b-4292-b08c-8efd725fe35a", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-657857206-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "68b3993c3a5c4fb386c82befaa7e0bf4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0640d9b5-ce", "ovs_interfaceid": "0640d9b5-cefd-4695-bfb3-52c78b9da7d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8b:4f:c6,bridge_name='br-int',has_traffic_filtering=True,id=0640d9b5-cefd-4695-bfb3-52c78b9da7d5,network=Network(7559216a-146b-4292-b08c-8efd725fe35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0640d9b5-ce') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG os_vif [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:4f:c6,bridge_name='br-int',has_traffic_filtering=True,id=0640d9b5-cefd-4695-bfb3-52c78b9da7d5,network=Network(7559216a-146b-4292-b08c-8efd725fe35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0640d9b5-ce') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0640d9b5-ce, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aa446bd6-cfec-466a-95c8-b210a72fd05b) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:03 user nova-compute[75826]: INFO os_vif [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8b:4f:c6,bridge_name='br-int',has_traffic_filtering=True,id=0640d9b5-cefd-4695-bfb3-52c78b9da7d5,network=Network(7559216a-146b-4292-b08c-8efd725fe35a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0640d9b5-ce')
Nov 16 00:41:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zkHKFXtG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:03 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b1415b-cd50-46b9-b7b9-e031e7b6aa0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:41:03 user nova-compute[75826]: No targets found.
Nov 16 00:41:03 user nova-compute[75826]: iSNS:
Nov 16 00:41:03 user nova-compute[75826]: No targets found.
Nov 16 00:41:03 user nova-compute[75826]: STATIC:
Nov 16 00:41:03 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632
Nov 16 00:41:03 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:03 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:03 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0
Nov 16 00:41:03 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:03 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:03 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf
Nov 16 00:41:03 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:03 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:03 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c
Nov 16 00:41:03 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:03 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:03 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432
Nov 16 00:41:03 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:03 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:03 user nova-compute[75826]: FIRMWARE:
Nov 16 00:41:03 user nova-compute[75826]: No targets found.
Nov 16 00:41:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:41:03 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:41:03 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c33034-e211-4d66-abac-d458a09a26ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8270584-3a40-40bf-9130-e3461e21c83f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:03 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:03 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:03 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:03 user nova-compute[75826]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 (non-flash)
Nov 16 00:41:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:03 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:03 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:03 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:03 user nova-compute[75826]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 (non-flash)
Nov 16 00:41:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb4253010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0'): ({'sdf'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Removing single pathed devices sdf {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2a7c83-0fc6-41f3-bb2e-d654ed7467a6]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c16b6f-4723-4367-9f9e-0ec9e30dc51a]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Flushing IO for device /dev/sdf {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[96150e31-f719-4fdf-a933-8620b1119205]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:41:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4b5e54-095b-4344-9231-a5226347a386]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd34984a-e23e-4d0f-be68-bf54e6f15b44]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9241691b-1a42-445f-9806-12814b00bf63]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0, portal: 172.16.0.220,3260]
Nov 16 00:41:04 user nova-compute[75826]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:04 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a2181e80-5191-4ab5-8456-9e124be94be0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc923c4b-e85b-4fb4-b41c-003d1f43e44b]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] <== disconnect_volume: return (311ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:41:04 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Deleting instance files /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d_del
Nov 16 00:41:04 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Deletion of /opt/stack/data/nova/instances/ee7b37f1-ac3b-4257-b463-790b3d19770d_del complete
Nov 16 00:41:04 user nova-compute[75826]: INFO nova.compute.manager [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 16 00:41:04 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:04 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Took 0.45 seconds to deallocate network for instance.
Nov 16 00:41:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-7ba7a330-952f-4e7d-bc07-9af35e950e10 req-f5059dd5-8300-48e2-9bb8-2fbed8f28154 service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Received event network-vif-deleted-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:04 user nova-compute[75826]: INFO nova.compute.manager [req-7ba7a330-952f-4e7d-bc07-9af35e950e10 req-f5059dd5-8300-48e2-9bb8-2fbed8f28154 service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Neutron deleted interface 0640d9b5-cefd-4695-bfb3-52c78b9da7d5; detaching it from the instance and deleting it from the info cache
Nov 16 00:41:04 user nova-compute[75826]: DEBUG nova.network.neutron [req-7ba7a330-952f-4e7d-bc07-9af35e950e10 req-f5059dd5-8300-48e2-9bb8-2fbed8f28154 service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-7ba7a330-952f-4e7d-bc07-9af35e950e10 req-f5059dd5-8300-48e2-9bb8-2fbed8f28154 service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Detach interface failed, port_id=0640d9b5-cefd-4695-bfb3-52c78b9da7d5, reason: Instance ee7b37f1-ac3b-4257-b463-790b3d19770d could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:41:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-d794a0bb-58a5-41e2-b202-7034cb3d7026 req-887a65b0-39b2-4541-9a46-bec4aec9eceb service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Received event network-vif-plugged-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d794a0bb-58a5-41e2-b202-7034cb3d7026 req-887a65b0-39b2-4541-9a46-bec4aec9eceb service nova] Acquiring lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d794a0bb-58a5-41e2-b202-7034cb3d7026 req-887a65b0-39b2-4541-9a46-bec4aec9eceb service nova] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d794a0bb-58a5-41e2-b202-7034cb3d7026 req-887a65b0-39b2-4541-9a46-bec4aec9eceb service nova] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-d794a0bb-58a5-41e2-b202-7034cb3d7026 req-887a65b0-39b2-4541-9a46-bec4aec9eceb service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] No waiting events found dispatching network-vif-plugged-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:05 user nova-compute[75826]: WARNING nova.compute.manager [req-d794a0bb-58a5-41e2-b202-7034cb3d7026 req-887a65b0-39b2-4541-9a46-bec4aec9eceb service nova] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Received unexpected event network-vif-plugged-0640d9b5-cefd-4695-bfb3-52c78b9da7d5 for instance with vm_state active and task_state deleting.
Nov 16 00:41:05 user nova-compute[75826]: INFO nova.compute.manager [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] [instance: ee7b37f1-ac3b-4257-b463-790b3d19770d] Took 0.73 seconds to detach 1 volumes for instance.
Nov 16 00:41:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:05 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:41:05 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:41:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:05 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Deleted allocations for instance ee7b37f1-ac3b-4257-b463-790b3d19770d
Nov 16 00:41:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f786d875-b322-4242-8144-0520c3969998 tempest-DeleteServersTestJSON-658187176 tempest-DeleteServersTestJSON-658187176-project-member] Lock "ee7b37f1-ac3b-4257-b463-790b3d19770d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.148s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-ed3dc158-1315-41e5-94db-43fcc1b67eda req-791b384d-1f1e-417f-9474-151939efcabd service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Received event network-changed-e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-ed3dc158-1315-41e5-94db-43fcc1b67eda req-791b384d-1f1e-417f-9474-151939efcabd service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Refreshing instance network info cache due to event network-changed-e7134fec-93d3-43b3-ba14-b08aa94c3cdf. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:41:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ed3dc158-1315-41e5-94db-43fcc1b67eda req-791b384d-1f1e-417f-9474-151939efcabd service nova] Acquiring lock "refresh_cache-d9ac6719-80f7-490a-a51e-869b51118aa2" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:41:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ed3dc158-1315-41e5-94db-43fcc1b67eda req-791b384d-1f1e-417f-9474-151939efcabd service nova] Acquired lock "refresh_cache-d9ac6719-80f7-490a-a51e-869b51118aa2" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:41:15 user nova-compute[75826]: DEBUG nova.network.neutron [req-ed3dc158-1315-41e5-94db-43fcc1b67eda req-791b384d-1f1e-417f-9474-151939efcabd service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Refreshing network info cache for port e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:41:16 user nova-compute[75826]: DEBUG nova.network.neutron [req-ed3dc158-1315-41e5-94db-43fcc1b67eda req-791b384d-1f1e-417f-9474-151939efcabd service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Updated VIF entry in instance network info cache for port e7134fec-93d3-43b3-ba14-b08aa94c3cdf. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:41:16 user nova-compute[75826]: DEBUG nova.network.neutron [req-ed3dc158-1315-41e5-94db-43fcc1b67eda req-791b384d-1f1e-417f-9474-151939efcabd service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Updating instance_info_cache with network_info: [{"id": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "address": "fa:16:3e:03:9a:ea", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7134fec-93", "ovs_interfaceid": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ed3dc158-1315-41e5-94db-43fcc1b67eda req-791b384d-1f1e-417f-9474-151939efcabd service nova] Releasing lock "refresh_cache-d9ac6719-80f7-490a-a51e-869b51118aa2" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "d9ac6719-80f7-490a-a51e-869b51118aa2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG nova.objects.instance [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lazy-loading 'flavor' on Instance uuid d9ac6719-80f7-490a-a51e-869b51118aa2 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "d9ac6719-80f7-490a-a51e-869b51118aa2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:18 user nova-compute[75826]: INFO nova.compute.manager [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Attaching volume e42c2ab8-accb-4244-9ecb-a967bedcb4b7 to /dev/vdb
Nov 16 00:41:18 user nova-compute[75826]: DEBUG os_brick.utils [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c763452-5a99-47b9-8738-ae8ada953aa4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf9ec44-eaad-4429-8276-701b17802ce8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9ae617-f378-4d27-a0e2-e42be770034f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f0ea65-7004-4eaa-ab4e-ffd2c2078527]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:41:18 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:41:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa0c04b-5033-45be-a744-963f9c38ced4]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG os_brick.utils [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:18 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Updating existing volume attachment record: 9913bf6f-4843-43b5-a502-c64db98be0e2 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:41:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-d0a72e12-4c57-4292-8969-e2665906afa5 req-dd58f327-0ace-4d24-bf8b-25d63ed60d68 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Received event network-changed-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-d0a72e12-4c57-4292-8969-e2665906afa5 req-dd58f327-0ace-4d24-bf8b-25d63ed60d68 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Refreshing instance network info cache due to event network-changed-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:41:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d0a72e12-4c57-4292-8969-e2665906afa5 req-dd58f327-0ace-4d24-bf8b-25d63ed60d68 service nova] Acquiring lock "refresh_cache-8946e093-6440-479f-95bc-c65391b9d2ba" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:41:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d0a72e12-4c57-4292-8969-e2665906afa5 req-dd58f327-0ace-4d24-bf8b-25d63ed60d68 service nova] Acquired lock "refresh_cache-8946e093-6440-479f-95bc-c65391b9d2ba" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:41:21 user nova-compute[75826]: DEBUG nova.network.neutron [req-d0a72e12-4c57-4292-8969-e2665906afa5 req-dd58f327-0ace-4d24-bf8b-25d63ed60d68 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Refreshing network info cache for port 82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:41:21 user nova-compute[75826]: DEBUG nova.network.neutron [req-d0a72e12-4c57-4292-8969-e2665906afa5 req-dd58f327-0ace-4d24-bf8b-25d63ed60d68 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Updated VIF entry in instance network info cache for port 82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:41:21 user nova-compute[75826]: DEBUG nova.network.neutron [req-d0a72e12-4c57-4292-8969-e2665906afa5 req-dd58f327-0ace-4d24-bf8b-25d63ed60d68 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Updating instance_info_cache with network_info: [{"id": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "address": "fa:16:3e:bb:12:6d", "network": {"id": "e3392f0b-2086-42ef-8292-84e785b0f697", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1543909989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "571b03a1cf0e43c28d8ca716b737c558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82340bab-a0", "ovs_interfaceid": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d0a72e12-4c57-4292-8969-e2665906afa5 req-dd58f327-0ace-4d24-bf8b-25d63ed60d68 service nova] Releasing lock "refresh_cache-8946e093-6440-479f-95bc-c65391b9d2ba" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Acquiring lock "e9c58516-5dba-49b0-b94d-119adbbe8529" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Acquiring lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:22 user nova-compute[75826]: INFO nova.compute.manager [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Terminating instance
Nov 16 00:41:22 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-49060ae7-6b77-4537-9058-63d5e310ae23 req-c3a0adeb-ac1e-45db-866f-545c60f4caab service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Received event network-vif-unplugged-ffeb91d2-58af-4045-9800-31518faad394 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-49060ae7-6b77-4537-9058-63d5e310ae23 req-c3a0adeb-ac1e-45db-866f-545c60f4caab service nova] Acquiring lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-49060ae7-6b77-4537-9058-63d5e310ae23 req-c3a0adeb-ac1e-45db-866f-545c60f4caab service nova] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-49060ae7-6b77-4537-9058-63d5e310ae23 req-c3a0adeb-ac1e-45db-866f-545c60f4caab service nova] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-49060ae7-6b77-4537-9058-63d5e310ae23 req-c3a0adeb-ac1e-45db-866f-545c60f4caab service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] No waiting events found dispatching network-vif-unplugged-ffeb91d2-58af-4045-9800-31518faad394 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-49060ae7-6b77-4537-9058-63d5e310ae23 req-c3a0adeb-ac1e-45db-866f-545c60f4caab service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Received event network-vif-unplugged-ffeb91d2-58af-4045-9800-31518faad394 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:41:23 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Instance destroyed successfully.
Nov 16 00:41:23 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lazy-loading 'resources' on Instance uuid e9c58516-5dba-49b0-b94d-119adbbe8529 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1626287548',display_name='tempest-VolumesActionsTest-instance-1626287548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1626287548',id=6,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='950b8891b252440daf6ef1b3400b0f52',ramdisk_id='',reservation_id='r-5k7p8zso',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-890137240',owner_user_name='tempest-VolumesActionsTest-890137240-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:39:40Z,user_data=None,user_id='a6a4fb21becf47aca4dd42739c9cffa1',uuid=e9c58516-5dba-49b0-b94d-119adbbe8529,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ffeb91d2-58af-4045-9800-31518faad394", "address": "fa:16:3e:f5:c3:be", "network": {"id": "8d83dcd3-7c5e-4524-955d-0276d77888a6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-121467616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "950b8891b252440daf6ef1b3400b0f52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffeb91d2-58", "ovs_interfaceid": "ffeb91d2-58af-4045-9800-31518faad394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Converting VIF {"id": "ffeb91d2-58af-4045-9800-31518faad394", "address": "fa:16:3e:f5:c3:be", "network": {"id": "8d83dcd3-7c5e-4524-955d-0276d77888a6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-121467616-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "950b8891b252440daf6ef1b3400b0f52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapffeb91d2-58", "ovs_interfaceid": "ffeb91d2-58af-4045-9800-31518faad394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=ffeb91d2-58af-4045-9800-31518faad394,network=Network(8d83dcd3-7c5e-4524-955d-0276d77888a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffeb91d2-58') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_vif [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=ffeb91d2-58af-4045-9800-31518faad394,network=Network(8d83dcd3-7c5e-4524-955d-0276d77888a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffeb91d2-58') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapffeb91d2-58, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0cd843b-623f-4ddc-a048-935cb068bc7a) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:23 user nova-compute[75826]: INFO os_vif [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:c3:be,bridge_name='br-int',has_traffic_filtering=True,id=ffeb91d2-58af-4045-9800-31518faad394,network=Network(8d83dcd3-7c5e-4524-955d-0276d77888a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapffeb91d2-58')
Nov 16 00:41:23 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Deleting instance files /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529_del
Nov 16 00:41:23 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Deletion of /opt/stack/data/nova/instances/e9c58516-5dba-49b0-b94d-119adbbe8529_del complete
Nov 16 00:41:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-20a50663-9abb-4c4d-bcf0-1609a99b5f5a req-e669e54f-6d71-481a-a23e-aa4d4152b865 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received event network-changed-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-20a50663-9abb-4c4d-bcf0-1609a99b5f5a req-e669e54f-6d71-481a-a23e-aa4d4152b865 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Refreshing instance network info cache due to event network-changed-a3083677-00f2-46e4-be46-fe34b463d6a4. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-20a50663-9abb-4c4d-bcf0-1609a99b5f5a req-e669e54f-6d71-481a-a23e-aa4d4152b865 service nova] Acquiring lock "refresh_cache-33f2b149-1951-44d0-a65a-018316b31712" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-20a50663-9abb-4c4d-bcf0-1609a99b5f5a req-e669e54f-6d71-481a-a23e-aa4d4152b865 service nova] Acquired lock "refresh_cache-33f2b149-1951-44d0-a65a-018316b31712" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG nova.network.neutron [req-20a50663-9abb-4c4d-bcf0-1609a99b5f5a req-e669e54f-6d71-481a-a23e-aa4d4152b865 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Refreshing network info cache for port a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:41:23 user nova-compute[75826]: INFO nova.compute.manager [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:41:23 user nova-compute[75826]: INFO nova.compute.manager [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Rebuilding instance
Nov 16 00:41:23 user nova-compute[75826]: DEBUG nova.compute.manager [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUghsOBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:23 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:23 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:23 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc49581-92c2-4712-aa73-19f0f8e1700d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:41:23 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dc396f-df48-4efc-9a84-77b60e01599d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7] added
Nov 16 00:41:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[17916c16-94fd-4f81-9ec2-04653485e0eb]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e436d8f-ff92-4c6e-9b5c-913747fe1c83]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUghsOBm {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eUghsOBm" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1028b8-d4cb-4e84-b918-3ad6afcc830c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eUghsOBm'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[401683e8-b954-4bed-aab0-27bdbf79385c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[055cbb53-24d8-4788-858a-a83a30d40862]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:23 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:23 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:23 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:23 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:23 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:23 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a1e94e-2d14-48eb-8c45-bb167fd45cb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7, portal: 172.16.0.220,3260]
Nov 16 00:41:24 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:24 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[205a84f7-5039-4f90-bf85-047add73fd6e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "8946e093-6440-479f-95bc-c65391b9d2ba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "8946e093-6440-479f-95bc-c65391b9d2ba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.objects.instance [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lazy-loading 'flavor' on Instance uuid 8946e093-6440-479f-95bc-c65391b9d2ba {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.049s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ae92d7-db54-47e8-90a0-884a84f7d278]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:24 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:24 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:24 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:24 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:24 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:24 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:24 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:24 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:24 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:24 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.network.neutron [req-20a50663-9abb-4c4d-bcf0-1609a99b5f5a req-e669e54f-6d71-481a-a23e-aa4d4152b865 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Updated VIF entry in instance network info cache for port a3083677-00f2-46e4-be46-fe34b463d6a4. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.network.neutron [req-20a50663-9abb-4c4d-bcf0-1609a99b5f5a req-e669e54f-6d71-481a-a23e-aa4d4152b865 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Updating instance_info_cache with network_info: [{"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4524bb6-ffb6-49c3-84e7-b12bd8cf8370]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-20a50663-9abb-4c4d-bcf0-1609a99b5f5a req-e669e54f-6d71-481a-a23e-aa4d4152b865 service nova] Releasing lock "refresh_cache-33f2b149-1951-44d0-a65a-018316b31712" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUghsOBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "8946e093-6440-479f-95bc-c65391b9d2ba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "8946e093-6440-479f-95bc-c65391b9d2ba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "8946e093-6440-479f-95bc-c65391b9d2ba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:24 user nova-compute[75826]: INFO nova.compute.manager [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Attaching volume 171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 to /dev/sdc
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.utils [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:24 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Took 1.03 seconds to deallocate network for instance.
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a3f730-08a6-4de6-a693-551505b31b4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:24 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Instance destroyed successfully.
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:24 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Instance destroyed successfully.
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-282460160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1379364694',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCXS8mfCk4vTQ8KvD02SkTq5b8gadS3Dv2Lo+h6cewehr3vqpTDQTQHj0qaShguaufSxu99avO/2zXpxPkqDPHOswK5I94kwnDiKdL++s2lPV/rz6rgG0dXcQu0zhVySw==',key_name='tempest-keypair-1471744927',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b28d760459a430b9116e57172e64a77',ramdisk_id='',reservation_id='r-qvs9it1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1015349843',owner_user_name='tempest-ServerActionsV293TestJSON-1015349843-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44daf19202c4460a56205d614f05118',uuid=33f2b149-1951-44d0-a65a-018316b31712,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Converting VIF {"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_vif [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3083677-00, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33ca21e-a03b-4a17-9d7d-bf746f0a3c0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d2c9385-4c57-4067-a8a4-5f521f72396a) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:24 user nova-compute[75826]: INFO os_vif [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00')
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbUymzfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:24 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[810e2531-6362-4471-847e-84c9b01c9db8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f8f987-3acc-4e8c-80da-d58acefb668b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:41:24 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca24a44-5f4b-46dd-b50a-839cb92b6d02]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG os_brick.utils [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Updating existing volume attachment record: b7c4c31a-8cce-4c30-9cc0-fd6a2e087309 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "interface-203da1ce-e5b1-4a16-a75e-e934c68d6e68-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "interface-203da1ce-e5b1-4a16-a75e-e934c68d6e68-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.objects.instance [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lazy-loading 'flavor' on Instance uuid 203da1ce-e5b1-4a16-a75e-e934c68d6e68 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Received event network-vif-plugged-ffeb91d2-58af-4045-9800-31518faad394 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] Acquiring lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] No waiting events found dispatching network-vif-plugged-ffeb91d2-58af-4045-9800-31518faad394 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:24 user nova-compute[75826]: WARNING nova.compute.manager [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Received unexpected event network-vif-plugged-ffeb91d2-58af-4045-9800-31518faad394 for instance with vm_state deleted and task_state None.
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received event network-vif-unplugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] Acquiring lock "33f2b149-1951-44d0-a65a-018316b31712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] No waiting events found dispatching network-vif-unplugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:24 user nova-compute[75826]: WARNING nova.compute.manager [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received unexpected event network-vif-unplugged-a3083677-00f2-46e4-be46-fe34b463d6a4 for instance with vm_state active and task_state rebuilding.
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received event network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] Acquiring lock "33f2b149-1951-44d0-a65a-018316b31712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] No waiting events found dispatching network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:24 user nova-compute[75826]: WARNING nova.compute.manager [req-54ba028d-dca7-408a-8576-80fba936e86a req-71896b1a-1135-4875-880a-93a55a183779 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received unexpected event network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 for instance with vm_state active and task_state rebuilding.
Nov 16 00:41:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.objects.instance [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lazy-loading 'pci_requests' on Instance uuid 203da1ce-e5b1-4a16-a75e-e934c68d6e68 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.objects.base [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Object Instance<203da1ce-e5b1-4a16-a75e-e934c68d6e68> lazy-loaded attributes: flavor,pci_requests {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:41:25 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Deleted allocations for instance e9c58516-5dba-49b0-b94d-119adbbe8529
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.policy [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '159de45699cb47c68211051c7f62dae4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e313a75f9fc4e91b5866d0228336b0b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4899eedb-d257-46b0-9f3b-ddae336bdd24 tempest-VolumesActionsTest-890137240 tempest-VolumesActionsTest-890137240-project-member] Lock "e9c58516-5dba-49b0-b94d-119adbbe8529" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.614s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.422s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] <== connect_volume: return (1423ms) {'type': 'block', 'scsi_wwn': '26561333562386566', 'path': '/dev/sdf'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561333562386566', 'path': '/dev/sdf'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.623s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.objects.instance [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lazy-loading 'flavor' on Instance uuid d9ac6719-80f7-490a-a51e-869b51118aa2 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f4ec23-f78d-4fc5-846a-900aca735cd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:41:25 user nova-compute[75826]: No targets found.
Nov 16 00:41:25 user nova-compute[75826]: iSNS:
Nov 16 00:41:25 user nova-compute[75826]: No targets found.
Nov 16 00:41:25 user nova-compute[75826]: STATIC:
Nov 16 00:41:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7
Nov 16 00:41:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632
Nov 16 00:41:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf
Nov 16 00:41:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c
Nov 16 00:41:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432
Nov 16 00:41:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:25 user nova-compute[75826]: FIRMWARE:
Nov 16 00:41:25 user nova-compute[75826]: No targets found.
Nov 16 00:41:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:41:25 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:41:25 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:41:25 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:25 user nova-compute[75826]:   <source dev="/dev/sdf"/>
Nov 16 00:41:25 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:41:25 user nova-compute[75826]:   <serial>e42c2ab8-accb-4244-9ecb-a967bedcb4b7</serial>
Nov 16 00:41:25 user nova-compute[75826]: </disk>
Nov 16 00:41:25 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ac6b13-300a-47eb-8f71-47485ff87c4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbfabff-926b-4ec1-9883-4a63e212d561]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb42535b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632'): ({'sdb'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Removing single pathed devices sdb {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab61337-5dff-4545-98ba-6eb6527ae87f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7719f964-742c-4226-9b89-a9b614adf03b]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Flushing IO for device /dev/sdb {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a17aaf2-b6cd-4e56-abd8-5e5468c5c3d0]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e594427-c765-4026-8f71-95688e89030e]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e386cc6d-d004-4861-8742-30b52e7a240c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-c1dd971a-436a-49dd-936f-28e43767b340 req-7dd9d927-7fdf-4322-8313-54729f240594 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-changed-ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-c1dd971a-436a-49dd-936f-28e43767b340 req-7dd9d927-7fdf-4322-8313-54729f240594 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Refreshing instance network info cache due to event network-changed-ebabaf39-8f6c-4790-b555-271d5aef9db8. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c1dd971a-436a-49dd-936f-28e43767b340 req-7dd9d927-7fdf-4322-8313-54729f240594 service nova] Acquiring lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c1dd971a-436a-49dd-936f-28e43767b340 req-7dd9d927-7fdf-4322-8313-54729f240594 service nova] Acquired lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.network.neutron [req-c1dd971a-436a-49dd-936f-28e43767b340 req-7dd9d927-7fdf-4322-8313-54729f240594 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Refreshing network info cache for port ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[003c6bd1-1341-4806-b24b-558302ae9133]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260]
Nov 16 00:41:25 user nova-compute[75826]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4f7349-900b-4f9a-9f8b-7effe3d2bfc4]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] <== disconnect_volume: return (978ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:41:25 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Deleting instance files /opt/stack/data/nova/instances/33f2b149-1951-44d0-a65a-018316b31712_del
Nov 16 00:41:25 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Deletion of /opt/stack/data/nova/instances/33f2b149-1951-44d0-a65a-018316b31712_del complete
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] No VIF found with MAC fa:16:3e:03:9a:ea, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:41:25 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 33f2b149-1951-44d0-a65a-018316b31712 could not be found.
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbUymzfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:25 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Successfully created port: 3ed8b208-8715-4d4b-8be5-7ad437342e88 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5416e39-4373-4e5a-9783-c774b26337ca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:41:25 user nova-compute[75826]: No targets found.
Nov 16 00:41:25 user nova-compute[75826]: iSNS:
Nov 16 00:41:25 user nova-compute[75826]: No targets found.
Nov 16 00:41:25 user nova-compute[75826]: STATIC:
Nov 16 00:41:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7
Nov 16 00:41:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf
Nov 16 00:41:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c
Nov 16 00:41:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432
Nov 16 00:41:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:25 user nova-compute[75826]: FIRMWARE:
Nov 16 00:41:25 user nova-compute[75826]: No targets found.
Nov 16 00:41:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:41:25 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:41:25 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e33e1e8-97ab-4043-9c04-72fcfce0bc49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e826b25-964e-4a1c-8da7-c32e7e2ddddb tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.211s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a5fea4-c08c-45aa-8222-a37b4c59742d]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:25 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb45ed630>, {}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Disconnecting from: [] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.091s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] <== disconnect_volume: return (91ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.network.neutron [req-c1dd971a-436a-49dd-936f-28e43767b340 req-7dd9d927-7fdf-4322-8313-54729f240594 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Updated VIF entry in instance network info cache for port ebabaf39-8f6c-4790-b555-271d5aef9db8. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.network.neutron [req-c1dd971a-436a-49dd-936f-28e43767b340 req-7dd9d927-7fdf-4322-8313-54729f240594 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Updating instance_info_cache with network_info: [{"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c1dd971a-436a-49dd-936f-28e43767b340 req-7dd9d927-7fdf-4322-8313-54729f240594 service nova] Releasing lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:41:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-c1dd971a-436a-49dd-936f-28e43767b340 req-7dd9d927-7fdf-4322-8313-54729f240594 service nova] [instance: e9c58516-5dba-49b0-b94d-119adbbe8529] Received event network-vif-deleted-ffeb91d2-58af-4045-9800-31518faad394 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:26 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Successfully updated port: 3ed8b208-8715-4d4b-8be5-7ad437342e88 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:41:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:41:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquired lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:41:26 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:41:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Preparing to wait for external event volume-reimaged-ef9dbcbd-3c51-40de-bfc8-4519b8543632 {{(pid=75826) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 16 00:41:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "33f2b149-1951-44d0-a65a-018316b31712-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "d9ac6719-80f7-490a-a51e-869b51118aa2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:26 user nova-compute[75826]: INFO nova.compute.manager [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Detaching volume e42c2ab8-accb-4244-9ecb-a967bedcb4b7
Nov 16 00:41:27 user nova-compute[75826]: INFO nova.virt.block_device [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Attempting to driver detach volume e42c2ab8-accb-4244-9ecb-a967bedcb4b7 from mountpoint /dev/vdb
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Attempting to detach device vdb from instance d9ac6719-80f7-490a-a51e-869b51118aa2 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:41:27 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:27 user nova-compute[75826]:   <source dev="/dev/sdf"/>
Nov 16 00:41:27 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:41:27 user nova-compute[75826]:   <serial>e42c2ab8-accb-4244-9ecb-a967bedcb4b7</serial>
Nov 16 00:41:27 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:41:27 user nova-compute[75826]: </disk>
Nov 16 00:41:27 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:41:27 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Successfully detached device vdb from instance d9ac6719-80f7-490a-a51e-869b51118aa2 from the persistent domain config.
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d9ac6719-80f7-490a-a51e-869b51118aa2 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:41:27 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:27 user nova-compute[75826]:   <source dev="/dev/sdf"/>
Nov 16 00:41:27 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:41:27 user nova-compute[75826]:   <serial>e42c2ab8-accb-4244-9ecb-a967bedcb4b7</serial>
Nov 16 00:41:27 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:41:27 user nova-compute[75826]: </disk>
Nov 16 00:41:27 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Updating instance_info_cache with network_info: [{"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Releasing lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73313562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73313562',id=9,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcxgQNIwtABwmWWY66lpLW4FahMujB4sq8+awLbY3j4T0F+WRfv6pOgZdlOEfsFFgqQNg0M3KAfXMF/9LBbJOCDmKtj5c59DNwM9T0+YoH3Fun1L1tu/xueB5ab2B1nPg==',key_name='tempest-keypair-1839588636',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6e313a75f9fc4e91b5866d0228336b0b',ramdisk_id='',reservation_id='r-1vf0ms0c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2144441547',owner_user_name='tempest-TaggedAttachmentsTest-2144441547-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:39:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='159de45699cb47c68211051c7f62dae4',uuid=203da1ce-e5b1-4a16-a75e-e934c68d6e68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converting VIF {"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed8b208-8715-4d4b-8be5-7ad437342e88,network=Network(bc4cb393-8a3e-4322-8f51-fc958631055d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed8b208-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG os_vif [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed8b208-8715-4d4b-8be5-7ad437342e88,network=Network(bc4cb393-8a3e-4322-8f51-fc958631055d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed8b208-87') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60fb0a09-97c5-5fb2-b582-c95136d1ef05', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ed8b208-87, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ed8b208-87, col_values=(('qos', UUID('5331d862-ab41-4c24-aef1-3b41d96cbf02')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ed8b208-87, col_values=(('external_ids', {'iface-id': '3ed8b208-8715-4d4b-8be5-7ad437342e88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:dd:4c', 'vm-uuid': '203da1ce-e5b1-4a16-a75e-e934c68d6e68'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:27 user nova-compute[75826]: INFO os_vif [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed8b208-8715-4d4b-8be5-7ad437342e88,network=Network(bc4cb393-8a3e-4322-8f51-fc958631055d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed8b208-87')
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73313562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73313562',id=9,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcxgQNIwtABwmWWY66lpLW4FahMujB4sq8+awLbY3j4T0F+WRfv6pOgZdlOEfsFFgqQNg0M3KAfXMF/9LBbJOCDmKtj5c59DNwM9T0+YoH3Fun1L1tu/xueB5ab2B1nPg==',key_name='tempest-keypair-1839588636',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6e313a75f9fc4e91b5866d0228336b0b',ramdisk_id='',reservation_id='r-1vf0ms0c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2144441547',owner_user_name='tempest-TaggedAttachmentsTest-2144441547-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:39:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='159de45699cb47c68211051c7f62dae4',uuid=203da1ce-e5b1-4a16-a75e-e934c68d6e68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converting VIF {"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed8b208-8715-4d4b-8be5-7ad437342e88,network=Network(bc4cb393-8a3e-4322-8f51-fc958631055d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed8b208-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] attach device xml: <interface type="ethernet">
Nov 16 00:41:27 user nova-compute[75826]:   <mac address="fa:16:3e:26:dd:4c"/>
Nov 16 00:41:27 user nova-compute[75826]:   <model type="virtio"/>
Nov 16 00:41:27 user nova-compute[75826]:   <mtu size="1442"/>
Nov 16 00:41:27 user nova-compute[75826]:   <target dev="tap3ed8b208-87"/>
Nov 16 00:41:27 user nova-compute[75826]: </interface>
Nov 16 00:41:27 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-acf66f68-b230-4eed-aa5a-6e2a405ccab2 req-e4ea21a7-bd16-4a5a-9f37-f84408187081 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-changed-3ed8b208-8715-4d4b-8be5-7ad437342e88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-acf66f68-b230-4eed-aa5a-6e2a405ccab2 req-e4ea21a7-bd16-4a5a-9f37-f84408187081 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Refreshing instance network info cache due to event network-changed-3ed8b208-8715-4d4b-8be5-7ad437342e88. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-acf66f68-b230-4eed-aa5a-6e2a405ccab2 req-e4ea21a7-bd16-4a5a-9f37-f84408187081 service nova] Acquiring lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-acf66f68-b230-4eed-aa5a-6e2a405ccab2 req-e4ea21a7-bd16-4a5a-9f37-f84408187081 service nova] Acquired lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.network.neutron [req-acf66f68-b230-4eed-aa5a-6e2a405ccab2 req-e4ea21a7-bd16-4a5a-9f37-f84408187081 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Refreshing network info cache for port 3ed8b208-8715-4d4b-8be5-7ad437342e88 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-9c85c003-19a6-4766-b5af-1bb64cadd44e req-944f2a6b-fda5-4355-8c00-40edda8d37bd service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-vif-plugged-3ed8b208-8715-4d4b-8be5-7ad437342e88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9c85c003-19a6-4766-b5af-1bb64cadd44e req-944f2a6b-fda5-4355-8c00-40edda8d37bd service nova] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9c85c003-19a6-4766-b5af-1bb64cadd44e req-944f2a6b-fda5-4355-8c00-40edda8d37bd service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9c85c003-19a6-4766-b5af-1bb64cadd44e req-944f2a6b-fda5-4355-8c00-40edda8d37bd service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-9c85c003-19a6-4766-b5af-1bb64cadd44e req-944f2a6b-fda5-4355-8c00-40edda8d37bd service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] No waiting events found dispatching network-vif-plugged-3ed8b208-8715-4d4b-8be5-7ad437342e88 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:27 user nova-compute[75826]: WARNING nova.compute.manager [req-9c85c003-19a6-4766-b5af-1bb64cadd44e req-944f2a6b-fda5-4355-8c00-40edda8d37bd service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received unexpected event network-vif-plugged-3ed8b208-8715-4d4b-8be5-7ad437342e88 for instance with vm_state active and task_state None.
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d9ac6719-80f7-490a-a51e-869b51118aa2 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.network.neutron [req-acf66f68-b230-4eed-aa5a-6e2a405ccab2 req-e4ea21a7-bd16-4a5a-9f37-f84408187081 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Updated VIF entry in instance network info cache for port 3ed8b208-8715-4d4b-8be5-7ad437342e88. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.network.neutron [req-acf66f68-b230-4eed-aa5a-6e2a405ccab2 req-e4ea21a7-bd16-4a5a-9f37-f84408187081 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Updating instance_info_cache with network_info: [{"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-acf66f68-b230-4eed-aa5a-6e2a405ccab2 req-e4ea21a7-bd16-4a5a-9f37-f84408187081 service nova] Releasing lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] No BDM found with device name hda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] No VIF found with MAC fa:16:3e:d3:17:39, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:41:28 user nova-compute[75826]:   <nova:package version="0.0.0"/>
Nov 16 00:41:28 user nova-compute[75826]:   <nova:name>tempest-device-tagging-server-73313562</nova:name>
Nov 16 00:41:28 user nova-compute[75826]:   <nova:creationTime>2023-11-16 00:41:28</nova:creationTime>
Nov 16 00:41:28 user nova-compute[75826]:   <nova:flavor name="m1.tiny">
Nov 16 00:41:28 user nova-compute[75826]:     <nova:memory>512</nova:memory>
Nov 16 00:41:28 user nova-compute[75826]:     <nova:disk>1</nova:disk>
Nov 16 00:41:28 user nova-compute[75826]:     <nova:swap>0</nova:swap>
Nov 16 00:41:28 user nova-compute[75826]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:41:28 user nova-compute[75826]:     <nova:vcpus>1</nova:vcpus>
Nov 16 00:41:28 user nova-compute[75826]:   </nova:flavor>
Nov 16 00:41:28 user nova-compute[75826]:   <nova:owner>
Nov 16 00:41:28 user nova-compute[75826]:     <nova:user uuid="159de45699cb47c68211051c7f62dae4">tempest-TaggedAttachmentsTest-2144441547-project-member</nova:user>
Nov 16 00:41:28 user nova-compute[75826]:     <nova:project uuid="6e313a75f9fc4e91b5866d0228336b0b">tempest-TaggedAttachmentsTest-2144441547</nova:project>
Nov 16 00:41:28 user nova-compute[75826]:   </nova:owner>
Nov 16 00:41:28 user nova-compute[75826]:   <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:41:28 user nova-compute[75826]:   <nova:ports>
Nov 16 00:41:28 user nova-compute[75826]:     <nova:port uuid="ebabaf39-8f6c-4790-b555-271d5aef9db8">
Nov 16 00:41:28 user nova-compute[75826]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:41:28 user nova-compute[75826]:     </nova:port>
Nov 16 00:41:28 user nova-compute[75826]:     <nova:port uuid="3ed8b208-8715-4d4b-8be5-7ad437342e88">
Nov 16 00:41:28 user nova-compute[75826]:       <nova:ip type="fixed" address="10.10.10.194" ipVersion="4"/>
Nov 16 00:41:28 user nova-compute[75826]:     </nova:port>
Nov 16 00:41:28 user nova-compute[75826]:   </nova:ports>
Nov 16 00:41:28 user nova-compute[75826]: </nova:instance>
Nov 16 00:41:28 user nova-compute[75826]:  {{(pid=75826) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ae9b7b8-efdc-4414-817a-9be9a08698dc tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "interface-203da1ce-e5b1-4a16-a75e-e934c68d6e68-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.275s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG nova.objects.instance [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lazy-loading 'flavor' on Instance uuid 203da1ce-e5b1-4a16-a75e-e934c68d6e68 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:28 user nova-compute[75826]: INFO nova.compute.manager [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Attaching volume 5a4a669b-5e9d-4dc3-81a9-b5044f358204 to /dev/vdb
Nov 16 00:41:28 user nova-compute[75826]: DEBUG os_brick.utils [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8eee223-3790-4fbe-9879-bf85a7ad9885]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28aa506-c5f3-49b4-b806-893e961f073e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[95100667-d79b-4e07-91be-d6095bb562a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a61cd1b-b73d-421b-af1b-4f1b3be497d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:41:28 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:41:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee17acdd-114f-432f-9821-f0669aed94e2]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG os_brick.utils [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Updating existing volume attachment record: ba4d4270-16ee-480b-9722-37dde5c8f55c {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:41:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-a6451bc9-5142-4ff9-add5-e51e01e165a5 req-6c22ab47-d532-4fb6-a2ac-969063e0b2af service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-vif-plugged-3ed8b208-8715-4d4b-8be5-7ad437342e88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a6451bc9-5142-4ff9-add5-e51e01e165a5 req-6c22ab47-d532-4fb6-a2ac-969063e0b2af service nova] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a6451bc9-5142-4ff9-add5-e51e01e165a5 req-6c22ab47-d532-4fb6-a2ac-969063e0b2af service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a6451bc9-5142-4ff9-add5-e51e01e165a5 req-6c22ab47-d532-4fb6-a2ac-969063e0b2af service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-a6451bc9-5142-4ff9-add5-e51e01e165a5 req-6c22ab47-d532-4fb6-a2ac-969063e0b2af service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] No waiting events found dispatching network-vif-plugged-3ed8b208-8715-4d4b-8be5-7ad437342e88 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:29 user nova-compute[75826]: WARNING nova.compute.manager [req-a6451bc9-5142-4ff9-add5-e51e01e165a5 req-6c22ab47-d532-4fb6-a2ac-969063e0b2af service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received unexpected event network-vif-plugged-3ed8b208-8715-4d4b-8be5-7ad437342e88 for instance with vm_state active and task_state None.
Nov 16 00:41:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxYbBLap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:29 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:29 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:29 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3755ed7-e92d-4920-8c96-d436f9575cbf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:41:29 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adb9f5f-474c-40e1-8572-f5dd039680d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1] added
Nov 16 00:41:29 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c211cb39-ff3a-414a-9bea-e1fdff4948da]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6edf3d7-27ea-483a-85c8-6bd80bf1f8b5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxYbBLap {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jxYbBLap" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e83c319-9759-4edb-823b-9de2f8b9c69d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jxYbBLap'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb70cec-40c1-426c-bd4f-0d98253f736f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b929b78-ee1a-4c9e-ad86-94f6b8d6c531]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:29 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:29 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[68928a61-a744-49ee-80ad-03cefa4f9f39]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1, portal: 172.16.0.220,3260]
Nov 16 00:41:29 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:29 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9407143f-9aca-4d99-9cf8-c6c27d259798]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa443ae-f027-4e7f-b2c4-a2e1ae78142f]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:29 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:29 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:29 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.290s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f11573-329b-47fc-8239-ac27b3f5b941]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:41:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxYbBLap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:41:30 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:30 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23766336131656633', 'path': '/dev/sdb'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766336131656633', 'path': '/dev/sdb'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:41:31 user nova-compute[75826]: DEBUG nova.objects.instance [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lazy-loading 'flavor' on Instance uuid 8946e093-6440-479f-95bc-c65391b9d2ba {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:41:31 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:31 user nova-compute[75826]:   <source dev="/dev/sdb"/>
Nov 16 00:41:31 user nova-compute[75826]:   <target dev="sdc" bus="scsi"/>
Nov 16 00:41:31 user nova-compute[75826]:   <serial>171e9f14-a3dc-4b65-99cc-5dceaa8d4db1</serial>
Nov 16 00:41:31 user nova-compute[75826]:   <address type="drive" controller="0" unit="2"/>
Nov 16 00:41:31 user nova-compute[75826]: </disk>
Nov 16 00:41:31 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:41:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] No BDM found with device name sda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] No VIF found with MAC fa:16:3e:bb:12:6d, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:41:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-09e9d884-11f9-4812-9cce-893b6ddb2534 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "8946e093-6440-479f-95bc-c65391b9d2ba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.346s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "8946e093-6440-479f-95bc-c65391b9d2ba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "8946e093-6440-479f-95bc-c65391b9d2ba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:32 user nova-compute[75826]: INFO nova.compute.manager [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Detaching volume 171e9f14-a3dc-4b65-99cc-5dceaa8d4db1
Nov 16 00:41:32 user nova-compute[75826]: INFO nova.virt.block_device [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Attempting to driver detach volume 171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 from mountpoint /dev/sdc
Nov 16 00:41:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Attempting to detach device sdc from instance 8946e093-6440-479f-95bc-c65391b9d2ba from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:41:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:41:32 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:32 user nova-compute[75826]:   <source dev="/dev/sdb"/>
Nov 16 00:41:32 user nova-compute[75826]:   <target dev="sdc" bus="scsi"/>
Nov 16 00:41:32 user nova-compute[75826]:   <serial>171e9f14-a3dc-4b65-99cc-5dceaa8d4db1</serial>
Nov 16 00:41:32 user nova-compute[75826]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 00:41:32 user nova-compute[75826]: </disk>
Nov 16 00:41:32 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:41:32 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Successfully detached device sdc from instance 8946e093-6440-479f-95bc-c65391b9d2ba from the persistent domain config.
Nov 16 00:41:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 8946e093-6440-479f-95bc-c65391b9d2ba from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:41:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:41:32 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:32 user nova-compute[75826]:   <source dev="/dev/sdb"/>
Nov 16 00:41:32 user nova-compute[75826]:   <target dev="sdc" bus="scsi"/>
Nov 16 00:41:32 user nova-compute[75826]:   <serial>171e9f14-a3dc-4b65-99cc-5dceaa8d4db1</serial>
Nov 16 00:41:32 user nova-compute[75826]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 16 00:41:32 user nova-compute[75826]: </disk>
Nov 16 00:41:32 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:41:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 8946e093-6440-479f-95bc-c65391b9d2ba {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJeKSXkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:33 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:33 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:33 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c27c99d-2fc4-45cc-b715-80ba9b3f23f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:41:33 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[94efc18f-9654-46dd-ba52-c9ac348e9ae5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204] added
Nov 16 00:41:33 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7159abe7-aefc-4fba-9a19-9a8d18aaf1d0]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[43a243b1-0696-41bb-a283-49be9941f320]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fJeKSXkE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fJeKSXkE" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66b50a8-8f72-493d-bb9b-0121239da96b]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fJeKSXkE'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a27f33-7bbd-4769-b0c8-49edaa8ccab2]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[741db501-4272-4bb9-b575-51f15cdf7c73]: (4, ('tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:33 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:33 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:33 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:33 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:33 user nova-compute[75826]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:33 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsi session list stdout=tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:33 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:33 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:33 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:33 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:33 user nova-compute[75826]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:33 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ef6aa6-44d7-4483-8313-97e1ab936235]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204, portal: 172.16.0.220,3260]
Nov 16 00:41:34 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c1221d-3f05-4908-8ea1-a1756813cd65]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6176124-53ea-40b6-8de4-808c7942e318]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:34 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:34 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:34 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:34 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:34 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:34 user nova-compute[75826]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:34 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:34 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:34 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:34 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:34 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:34 user nova-compute[75826]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[438b83f3-2e1e-4390-9961-3305c75a7707]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJeKSXkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-76c7c325-172c-4c6d-b9a6-74e7097ab2fc req-a1103040-e9cc-4c51-8986-05473264129a service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Received event network-changed-72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-76c7c325-172c-4c6d-b9a6-74e7097ab2fc req-a1103040-e9cc-4c51-8986-05473264129a service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Refreshing instance network info cache due to event network-changed-72a2f5c9-f73f-4207-926b-8b82e845f8b3. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-76c7c325-172c-4c6d-b9a6-74e7097ab2fc req-a1103040-e9cc-4c51-8986-05473264129a service nova] Acquiring lock "refresh_cache-4e2d6eb9-c31e-487c-807d-3bb8460f3a02" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-76c7c325-172c-4c6d-b9a6-74e7097ab2fc req-a1103040-e9cc-4c51-8986-05473264129a service nova] Acquired lock "refresh_cache-4e2d6eb9-c31e-487c-807d-3bb8460f3a02" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG nova.network.neutron [req-76c7c325-172c-4c6d-b9a6-74e7097ab2fc req-a1103040-e9cc-4c51-8986-05473264129a service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Refreshing network info cache for port 72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Acquiring lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lazy-loading 'flavor' on Instance uuid 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Acquiring lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:35 user nova-compute[75826]: INFO nova.compute.manager [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Attaching volume 83ab1a32-be63-4012-b80e-d0945bce3f7f to /dev/vdb
Nov 16 00:41:35 user nova-compute[75826]: DEBUG nova.network.neutron [req-76c7c325-172c-4c6d-b9a6-74e7097ab2fc req-a1103040-e9cc-4c51-8986-05473264129a service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Updated VIF entry in instance network info cache for port 72a2f5c9-f73f-4207-926b-8b82e845f8b3. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG nova.network.neutron [req-76c7c325-172c-4c6d-b9a6-74e7097ab2fc req-a1103040-e9cc-4c51-8986-05473264129a service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Updating instance_info_cache with network_info: [{"id": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "address": "fa:16:3e:78:d0:a7", "network": {"id": "dad71101-cc46-4510-bd10-70173e431b9f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-774900563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe51852d2e4213876d2bcba378c427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2f5c9-f7", "ovs_interfaceid": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-76c7c325-172c-4c6d-b9a6-74e7097ab2fc req-a1103040-e9cc-4c51-8986-05473264129a service nova] Releasing lock "refresh_cache-4e2d6eb9-c31e-487c-807d-3bb8460f3a02" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23764376339653035', 'path': '/dev/sdh'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764376339653035', 'path': '/dev/sdh'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG os_brick.utils [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG nova.objects.instance [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lazy-loading 'flavor' on Instance uuid 203da1ce-e5b1-4a16-a75e-e934c68d6e68 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cacd755-885f-46f0-bf6d-6917c5ac8571]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[06633e84-473a-4023-b6e6-55282b56e5b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:41:35 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:35 user nova-compute[75826]:   <source dev="/dev/sdh"/>
Nov 16 00:41:35 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:41:35 user nova-compute[75826]:   <serial>5a4a669b-5e9d-4dc3-81a9-b5044f358204</serial>
Nov 16 00:41:35 user nova-compute[75826]: </disk>
Nov 16 00:41:35 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef728ce0-b328-4a0c-9281-09596edba6eb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[86f47a9b-6269-4b74-9a37-f210ca8648c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:41:35 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1e9149-ee3b-40ca-99e9-e6ce22d50b3c]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG os_brick.utils [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] <== get_connector_properties: return (107ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Updating existing volume attachment record: 80176d05-ddb8-48c2-99bd-cb8a923baa8f {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] No BDM found with device name hda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] No VIF found with MAC fa:16:3e:d3:17:39, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:41:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cae6a44b-5ee8-4d27-bdd1-603879d84ef0 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.003s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:37 user nova-compute[75826]: INFO nova.compute.manager [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Detaching volume 5a4a669b-5e9d-4dc3-81a9-b5044f358204
Nov 16 00:41:37 user nova-compute[75826]: INFO nova.virt.block_device [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Attempting to driver detach volume 5a4a669b-5e9d-4dc3-81a9-b5044f358204 from mountpoint /dev/vdb
Nov 16 00:41:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Attempting to detach device vdb from instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:41:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:41:37 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:37 user nova-compute[75826]:   <source dev="/dev/sdh"/>
Nov 16 00:41:37 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:41:37 user nova-compute[75826]:   <serial>5a4a669b-5e9d-4dc3-81a9-b5044f358204</serial>
Nov 16 00:41:37 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 00:41:37 user nova-compute[75826]: </disk>
Nov 16 00:41:37 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:41:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Successfully detached device vdb from instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 from the persistent domain config.
Nov 16 00:41:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:41:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:41:37 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:37 user nova-compute[75826]:   <source dev="/dev/sdh"/>
Nov 16 00:41:37 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:41:37 user nova-compute[75826]:   <serial>5a4a669b-5e9d-4dc3-81a9-b5044f358204</serial>
Nov 16 00:41:37 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 00:41:37 user nova-compute[75826]: </disk>
Nov 16 00:41:37 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:41:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:41:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfGjLnWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:40 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:40 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:40 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb394f65-7c84-43a2-b33b-1a349c6a8f2b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:41:40 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccf989d-4ed9-488f-a4f3-a750188f5382]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f] added
Nov 16 00:41:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27a1ace-13e1-421c-92ee-23151ff05587]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3370b981-32df-47e8-a362-3af93cfdbc7a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfGjLnWb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfGjLnWb" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c2f4b1-d269-46be-b969-2a7e05289fd5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfGjLnWb'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[19433381-a694-45e3-81f4-1ce65f8e1081]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c453fa02-2712-4e07-b173-e98142717d9c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0ac82c-886a-42af-9677-372482ccd0e9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f, portal: 172.16.0.220,3260]
Nov 16 00:41:40 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bbc7c1-4ae8-4e41-a9c8-6acb2e486561]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d50e9a66-d325-4d0d-aa86-ca561e64986d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a02e5e-0100-445c-af01-761ab087a17b]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdg {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:41:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfGjLnWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:41:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23537386231393266', 'path': '/dev/sdg'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537386231393266', 'path': '/dev/sdg'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:41:41 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lazy-loading 'flavor' on Instance uuid 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] attach device xml: <disk type="block" device="disk">
Nov 16 00:41:41 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:41 user nova-compute[75826]:   <source dev="/dev/sdg"/>
Nov 16 00:41:41 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:41:41 user nova-compute[75826]:   <serial>83ab1a32-be63-4012-b80e-d0945bce3f7f</serial>
Nov 16 00:41:41 user nova-compute[75826]: </disk>
Nov 16 00:41:41 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-996c493a-cb16-4211-825d-3631af0abcd2 req-d798d92e-5d92-4fc3-93f6-b48fe6a84462 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received event volume-reimaged-ef9dbcbd-3c51-40de-bfc8-4519b8543632 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-996c493a-cb16-4211-825d-3631af0abcd2 req-d798d92e-5d92-4fc3-93f6-b48fe6a84462 service nova] Acquiring lock "33f2b149-1951-44d0-a65a-018316b31712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-996c493a-cb16-4211-825d-3631af0abcd2 req-d798d92e-5d92-4fc3-93f6-b48fe6a84462 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-996c493a-cb16-4211-825d-3631af0abcd2 req-d798d92e-5d92-4fc3-93f6-b48fe6a84462 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-996c493a-cb16-4211-825d-3631af0abcd2 req-d798d92e-5d92-4fc3-93f6-b48fe6a84462 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Processing event volume-reimaged-ef9dbcbd-3c51-40de-bfc8-4519b8543632 {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Instance event wait completed in 15 seconds for volume-reimaged {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:41:42 user nova-compute[75826]: INFO nova.virt.block_device [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Booting with volume ef9dbcbd-3c51-40de-bfc8-4519b8543632 at /dev/vda
Nov 16 00:41:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] No VIF found with MAC fa:16:3e:78:d0:a7, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG os_brick.utils [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8b68d2-272c-4bc3-880c-62dc94376f1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7350094-b7eb-4a83-a84c-cb0df26fcba0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f245fd35-1c0d-41e4-b7b2-1987fcca4e08]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[af78ed1f-7028-4c07-98bb-ebc2a97d3abd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:41:42 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[34a19208-ee1b-4857-83b9-bea7ebc31629]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG os_brick.utils [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Updating existing volume attachment record: fe403e4e-7288-4f99-a9e9-e7dbb01fba68 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6b8e4eda-a778-4f51-970a-64ad6d20e249 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.518s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c426478d-bced-4249-b723-7085a4745711 tempest-VolumesAssistedSnapshotsTest-735052314 tempest-VolumesAssistedSnapshotsTest-735052314-project] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] volume_snapshot_create: create_info: {'snapshot_id': '6a461d83-8755-4727-a7be-ec276c30ca88', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75826) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c426478d-bced-4249-b723-7085a4745711 tempest-VolumesAssistedSnapshotsTest-735052314 tempest-VolumesAssistedSnapshotsTest-735052314-project] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] snap xml: <domainsnapshot>
Nov 16 00:41:42 user nova-compute[75826]:   <disks>
Nov 16 00:41:42 user nova-compute[75826]:     <disk name="/dev/sdg" snapshot="external" type="file">
Nov 16 00:41:42 user nova-compute[75826]:       <source file="/dev/new_file"/>
Nov 16 00:41:42 user nova-compute[75826]:     </disk>
Nov 16 00:41:42 user nova-compute[75826]:     <disk name="vda" snapshot="no"/>
Nov 16 00:41:42 user nova-compute[75826]:   </disks>
Nov 16 00:41:42 user nova-compute[75826]: </domainsnapshot>
Nov 16 00:41:42 user nova-compute[75826]:  {{(pid=75826) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 16 00:41:42 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c426478d-bced-4249-b723-7085a4745711 tempest-VolumesAssistedSnapshotsTest-735052314 tempest-VolumesAssistedSnapshotsTest-735052314-project] Lazy-loading 'system_metadata' on Instance uuid 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c426478d-bced-4249-b723-7085a4745711 tempest-VolumesAssistedSnapshotsTest-735052314 tempest-VolumesAssistedSnapshotsTest-735052314-project] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [None req-c426478d-bced-4249-b723-7085a4745711 tempest-VolumesAssistedSnapshotsTest-735052314 tempest-VolumesAssistedSnapshotsTest-735052314-project] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Traceback (most recent call last):
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     rv = execute(f, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     six.reraise(c, e, tb)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     raise value
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     rv = meth(*args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] 
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [None req-c426478d-bced-4249-b723-7085a4745711 tempest-VolumesAssistedSnapshotsTest-735052314 tempest-VolumesAssistedSnapshotsTest-735052314-project] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Traceback (most recent call last):
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     self._volume_snapshot_create(context, instance, guest,
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     rv = execute(f, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     six.reraise(c, e, tb)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     raise value
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     rv = meth(*args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] 
Nov 16 00:41:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-efb9679a-cdbc-4bca-9f6d-a6d5aa68221b tempest-VolumesAssistedSnapshotsTest-735052314 tempest-VolumesAssistedSnapshotsTest-735052314-project] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] volume_snapshot_delete: delete_info: {'volume_id': '83ab1a32-be63-4012-b80e-d0945bce3f7f'} {{(pid=75826) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [None req-efb9679a-cdbc-4bca-9f6d-a6d5aa68221b tempest-VolumesAssistedSnapshotsTest-735052314 tempest-VolumesAssistedSnapshotsTest-735052314-project] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Traceback (most recent call last):
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02]     if delete_info['type'] != 'qcow2':
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] KeyError: 'type'
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] 
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [None req-c426478d-bced-4249-b723-7085a4745711 tempest-VolumesAssistedSnapshotsTest-735052314 tempest-VolumesAssistedSnapshotsTest-735052314-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 6a461d83-8755-4727-a7be-ec276c30ca88 could not be found.
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     raise value
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver 
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver 
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 6a461d83-8755-4727-a7be-ec276c30ca88 could not be found. (HTTP 404) (Request-ID: req-34f30aa6-a48a-4b60-ba19-309be4c2de80)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver 
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver 
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 6a461d83-8755-4727-a7be-ec276c30ca88 could not be found.
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver 
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver [None req-efb9679a-cdbc-4bca-9f6d-a6d5aa68221b tempest-VolumesAssistedSnapshotsTest-735052314 tempest-VolumesAssistedSnapshotsTest-735052314-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver 
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver 
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-e2a55f3d-8689-41e3-a688-205453bbf06a)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver 
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver 
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 16 00:41:42 user nova-compute[75826]: ERROR nova.virt.libvirt.driver 
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server [None req-c426478d-bced-4249-b723-7085a4745711 tempest-VolumesAssistedSnapshotsTest-735052314 tempest-VolumesAssistedSnapshotsTest-735052314-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     raise value
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server 
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server [None req-efb9679a-cdbc-4bca-9f6d-a6d5aa68221b tempest-VolumesAssistedSnapshotsTest-735052314 tempest-VolumesAssistedSnapshotsTest-735052314-project] Exception during message handling: KeyError: 'type'
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 16 00:41:42 user nova-compute[75826]: ERROR oslo_messaging.rpc.server 
Nov 16 00:41:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Acquiring lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:43 user nova-compute[75826]: INFO nova.compute.manager [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Detaching volume 83ab1a32-be63-4012-b80e-d0945bce3f7f
Nov 16 00:41:43 user nova-compute[75826]: INFO nova.virt.block_device [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Attempting to driver detach volume 83ab1a32-be63-4012-b80e-d0945bce3f7f from mountpoint /dev/vdb
Nov 16 00:41:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Attempting to detach device vdb from instance 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:41:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 00:41:43 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:43 user nova-compute[75826]:   <source dev="/dev/sdg"/>
Nov 16 00:41:43 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:41:43 user nova-compute[75826]:   <serial>83ab1a32-be63-4012-b80e-d0945bce3f7f</serial>
Nov 16 00:41:43 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:41:43 user nova-compute[75826]: </disk>
Nov 16 00:41:43 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:41:43 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Successfully detached device vdb from instance 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 from the persistent domain config.
Nov 16 00:41:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:41:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] detach device xml: <disk type="block" device="disk">
Nov 16 00:41:43 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:43 user nova-compute[75826]:   <source dev="/dev/sdg"/>
Nov 16 00:41:43 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:41:43 user nova-compute[75826]:   <serial>83ab1a32-be63-4012-b80e-d0945bce3f7f</serial>
Nov 16 00:41:43 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:41:43 user nova-compute[75826]: </disk>
Nov 16 00:41:43 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:41:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:41:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-c8e691d8-937f-4232-a911-617c889b9fa5 req-7eced6ec-c740-40a4-bff6-f5b3dbd298a8 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-changed-84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-c8e691d8-937f-4232-a911-617c889b9fa5 req-7eced6ec-c740-40a4-bff6-f5b3dbd298a8 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing instance network info cache due to event network-changed-84598159-131b-4f3b-8bee-97257e504831. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:41:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c8e691d8-937f-4232-a911-617c889b9fa5 req-7eced6ec-c740-40a4-bff6-f5b3dbd298a8 service nova] Acquiring lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:41:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c8e691d8-937f-4232-a911-617c889b9fa5 req-7eced6ec-c740-40a4-bff6-f5b3dbd298a8 service nova] Acquired lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:41:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-c8e691d8-937f-4232-a911-617c889b9fa5 req-7eced6ec-c740-40a4-bff6-f5b3dbd298a8 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Refreshing network info cache for port 84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:41:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-c8e691d8-937f-4232-a911-617c889b9fa5 req-7eced6ec-c740-40a4-bff6-f5b3dbd298a8 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updated VIF entry in instance network info cache for port 84598159-131b-4f3b-8bee-97257e504831. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:41:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-c8e691d8-937f-4232-a911-617c889b9fa5 req-7eced6ec-c740-40a4-bff6-f5b3dbd298a8 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [{"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3b998d5a-b393-40c4-aeaf-864d935daafb", "address": "fa:16:3e:7d:48:21", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b998d5a-b3", "ovs_interfaceid": "3b998d5a-b393-40c4-aeaf-864d935daafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e2489a9a-e276-4520-8812-f00178685319", "address": "fa:16:3e:d6:6e:db", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2489a9a-e2", "ovs_interfaceid": "e2489a9a-e276-4520-8812-f00178685319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c8e691d8-937f-4232-a911-617c889b9fa5 req-7eced6ec-c740-40a4-bff6-f5b3dbd298a8 service nova] Releasing lock "refresh_cache-4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:47 user nova-compute[75826]: INFO nova.compute.manager [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Terminating instance
Nov 16 00:41:47 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-d6425d58-8e2c-46d0-b8b7-8ae82ecfde7a req-087d4f07-6668-49d9-9e3d-cc4ff228ce53 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d6425d58-8e2c-46d0-b8b7-8ae82ecfde7a req-087d4f07-6668-49d9-9e3d-cc4ff228ce53 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d6425d58-8e2c-46d0-b8b7-8ae82ecfde7a req-087d4f07-6668-49d9-9e3d-cc4ff228ce53 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d6425d58-8e2c-46d0-b8b7-8ae82ecfde7a req-087d4f07-6668-49d9-9e3d-cc4ff228ce53 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-d6425d58-8e2c-46d0-b8b7-8ae82ecfde7a req-087d4f07-6668-49d9-9e3d-cc4ff228ce53 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-unplugged-84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-d6425d58-8e2c-46d0-b8b7-8ae82ecfde7a req-087d4f07-6668-49d9-9e3d-cc4ff228ce53 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-84598159-131b-4f3b-8bee-97257e504831 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d9ac6719-80f7-490a-a51e-869b51118aa2 is timed out.
Nov 16 00:41:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Successfully detached device vdb from instance d9ac6719-80f7-490a-a51e-869b51118aa2 from the live domain config.
Nov 16 00:41:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eUghsOBm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:47 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ac375c-45dc-4765-b998-20993ea42dd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:41:47 user nova-compute[75826]: No targets found.
Nov 16 00:41:47 user nova-compute[75826]: iSNS:
Nov 16 00:41:47 user nova-compute[75826]: No targets found.
Nov 16 00:41:47 user nova-compute[75826]: STATIC:
Nov 16 00:41:47 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7
Nov 16 00:41:47 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:47 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:47 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204
Nov 16 00:41:47 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:47 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:47 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf
Nov 16 00:41:47 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:47 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:47 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1
Nov 16 00:41:47 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:47 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:47 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c
Nov 16 00:41:47 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:47 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:47 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f
Nov 16 00:41:47 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:47 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:47 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432
Nov 16 00:41:47 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:47 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:47 user nova-compute[75826]: FIRMWARE:
Nov 16 00:41:47 user nova-compute[75826]: No targets found.
Nov 16 00:41:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:41:47 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:41:47 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fe7ab4-39f1-4747-a849-5b9c9d07ef70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-e1dec5ff-60d2-4d68-9508-b878d5562cad req-9e94f7c4-7bc9-4a8a-af7b-ff7ea915a27c service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-8c765ac0-c657-4339-bd26-a7e5156efc55 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e1dec5ff-60d2-4d68-9508-b878d5562cad req-9e94f7c4-7bc9-4a8a-af7b-ff7ea915a27c service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e1dec5ff-60d2-4d68-9508-b878d5562cad req-9e94f7c4-7bc9-4a8a-af7b-ff7ea915a27c service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e1dec5ff-60d2-4d68-9508-b878d5562cad req-9e94f7c4-7bc9-4a8a-af7b-ff7ea915a27c service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-e1dec5ff-60d2-4d68-9508-b878d5562cad req-9e94f7c4-7bc9-4a8a-af7b-ff7ea915a27c service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-unplugged-8c765ac0-c657-4339-bd26-a7e5156efc55 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-e1dec5ff-60d2-4d68-9508-b878d5562cad req-9e94f7c4-7bc9-4a8a-af7b-ff7ea915a27c service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-8c765ac0-c657-4339-bd26-a7e5156efc55 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[876b5b53-b88a-4647-a48e-b3c085b52300]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:47 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:47 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:47 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:47 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:47 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:47 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:47 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:47 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:47 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:47 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:47 user nova-compute[75826]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 (non-flash)
Nov 16 00:41:47 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd94532200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7'): ({'sdf'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Removing single pathed devices sdf {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dd1ca0-2d6b-48bc-b927-03d27c1ca414]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[da591f98-7987-426f-b3f1-db002755a4d9]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Flushing IO for device /dev/sdf {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f018bce-77a0-41fd-a365-1133d3b5bc4d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.035s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d2003d-cfeb-499a-8b17-0ad034e82fd9]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ea4338-6f08-4e04-9786-1ba009b519b0]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf3d8c2-29c0-4202-9b97-84123922f167]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7, portal: 172.16.0.220,3260]
Nov 16 00:41:47 user nova-compute[75826]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e42c2ab8-accb-4244-9ecb-a967bedcb4b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.052s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[925bb8d6-e24b-4371-a25b-9d5249e4d6b2]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] <== disconnect_volume: return (415ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:41:48 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Creating image(s)
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Ensure instance console log exists: /opt/stack/data/nova/instances/33f2b149-1951-44d0-a65a-018316b31712/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Start _get_guest_xml network_info=[{"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'fe403e4e-7288-4f99-a9e9-e7dbb01fba68', 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbUymzfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '33f2b149-1951-44d0-a65a-018316b31712', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef9dbcbd-3c51-40de-bfc8-4519b8543632', 'serial': 'ef9dbcbd-3c51-40de-bfc8-4519b8543632'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:41:48 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 00:41:48 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.objects.instance [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lazy-loading 'vcpu_model' on Instance uuid 33f2b149-1951-44d0-a65a-018316b31712 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbUymzfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:48 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:48 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:48 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ca6d6f-1123-4f03-b9a2-875b8f73d143]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:41:48 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[45547446-b34d-4b67-bb6c-4c434ea2efde]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632] added
Nov 16 00:41:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[552c2ba9-4132-4ee5-b086-911a40f65fbc]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[92507c50-a158-478a-8819-0ec301a84701]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbUymzfW {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xbUymzfW" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[300ecc16-91a6-4138-b4c7-0b7b803a6649]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xbUymzfW'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26966fb-6f4c-4243-8f9b-1389366d4da4]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c166769-1220-40e2-aba6-1bd8a6fa170a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --login" returned: 0 in 0.122s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e43ed0-ebdd-4c3e-9288-22055c480a52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260]
Nov 16 00:41:48 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7636165-0274-4ff5-a1fd-ef33ad82ecca]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa8df21-e188-4514-9397-b0afd80eb4d3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:48 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] HCTL ('37', '-', '-', 0) found on session 12 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bee94a-4a35-4a3c-b384-e27e326fbfb8]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Searching for a device in session 12 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbUymzfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:41:48 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Instance destroyed successfully.
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lazy-loading 'resources' on Instance uuid 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:40:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:26:8e,bridge_name='br-int',has_traffic_filtering=True,id=84598159-131b-4f3b-8bee-97257e504831,network=Network(df29f611-0f85-46dd-b62c-d751f6aca045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84598159-13') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:26:8e,bridge_name='br-int',has_traffic_filtering=True,id=84598159-131b-4f3b-8bee-97257e504831,network=Network(df29f611-0f85-46dd-b62c-d751f6aca045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84598159-13') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84598159-13, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG nova.objects.instance [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lazy-loading 'flavor' on Instance uuid d9ac6719-80f7-490a-a51e-869b51118aa2 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c2869ea8-042a-49c4-9957-16102064b16f) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0e80b80a-27e6-49f9-bdf7-9fb5efda9f1d tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.015s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: INFO os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:26:8e,bridge_name='br-int',has_traffic_filtering=True,id=84598159-131b-4f3b-8bee-97257e504831,network=Network(df29f611-0f85-46dd-b62c-d751f6aca045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84598159-13')
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:40:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:72:11,bridge_name='br-int',has_traffic_filtering=True,id=3eb287a3-094b-4525-abd4-e60c8078ba61,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3eb287a3-09') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:72:11,bridge_name='br-int',has_traffic_filtering=True,id=3eb287a3-094b-4525-abd4-e60c8078ba61,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3eb287a3-09') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3eb287a3-09, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c469ccc0-4e87-431a-b0c5-e3bc38e8437c) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: INFO os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:72:11,bridge_name='br-int',has_traffic_filtering=True,id=3eb287a3-094b-4525-abd4-e60c8078ba61,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3eb287a3-09')
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:40:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:17:e1,bridge_name='br-int',has_traffic_filtering=True,id=8c765ac0-c657-4339-bd26-a7e5156efc55,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c765ac0-c6') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:17:e1,bridge_name='br-int',has_traffic_filtering=True,id=8c765ac0-c657-4339-bd26-a7e5156efc55,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c765ac0-c6') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c765ac0-c6, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cdc89bc-bfe7-40ed-bc00-3a58cb2040cf) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: INFO os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:17:e1,bridge_name='br-int',has_traffic_filtering=True,id=8c765ac0-c657-4339-bd26-a7e5156efc55,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8c765ac0-c6')
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:40:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b998d5a-b393-40c4-aeaf-864d935daafb", "address": "fa:16:3e:7d:48:21", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b998d5a-b3", "ovs_interfaceid": "3b998d5a-b393-40c4-aeaf-864d935daafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "3b998d5a-b393-40c4-aeaf-864d935daafb", "address": "fa:16:3e:7d:48:21", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b998d5a-b3", "ovs_interfaceid": "3b998d5a-b393-40c4-aeaf-864d935daafb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:48:21,bridge_name='br-int',has_traffic_filtering=True,id=3b998d5a-b393-40c4-aeaf-864d935daafb,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b998d5a-b3') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:48:21,bridge_name='br-int',has_traffic_filtering=True,id=3b998d5a-b393-40c4-aeaf-864d935daafb,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b998d5a-b3') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b998d5a-b3, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8935de3-8c4b-498c-a5e1-03492ccf8bdc) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: INFO os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:48:21,bridge_name='br-int',has_traffic_filtering=True,id=3b998d5a-b393-40c4-aeaf-864d935daafb,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b998d5a-b3')
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:40:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2489a9a-e276-4520-8812-f00178685319", "address": "fa:16:3e:d6:6e:db", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2489a9a-e2", "ovs_interfaceid": "e2489a9a-e276-4520-8812-f00178685319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "e2489a9a-e276-4520-8812-f00178685319", "address": "fa:16:3e:d6:6e:db", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2489a9a-e2", "ovs_interfaceid": "e2489a9a-e276-4520-8812-f00178685319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:db,bridge_name='br-int',has_traffic_filtering=True,id=e2489a9a-e276-4520-8812-f00178685319,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2489a9a-e2') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:db,bridge_name='br-int',has_traffic_filtering=True,id=e2489a9a-e276-4520-8812-f00178685319,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2489a9a-e2') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2489a9a-e2, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c1a940a8-7dc4-4bf1-811f-424a190cd53f) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: INFO os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:6e:db,bridge_name='br-int',has_traffic_filtering=True,id=e2489a9a-e276-4520-8812-f00178685319,network=Network(8eb8694d-7067-48d5-892f-d0ad33bff077),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2489a9a-e2')
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:40:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:88:66,bridge_name='br-int',has_traffic_filtering=True,id=a5bcc1ad-78d3-4302-beca-f4e4a27dfc59,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bcc1ad-78') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:88:66,bridge_name='br-int',has_traffic_filtering=True,id=a5bcc1ad-78d3-4302-beca-f4e4a27dfc59,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bcc1ad-78') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5bcc1ad-78, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2406dab8-36b5-4a5a-9fd0-de8c00bbd9ec) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: INFO os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:88:66,bridge_name='br-int',has_traffic_filtering=True,id=a5bcc1ad-78d3-4302-beca-f4e4a27dfc59,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5bcc1ad-78')
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1291003582',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1291003582',id=11,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI+Itu8B3siN0w9krr4GjrZhT9+tvlUtKRKsIjZJEtynBPYOjkitdpxHqDVlWqBZn4fmcaTmXLeTe8iFTUw/usbMtkN3e8SU44Da+dPUeZk5Q9dW/kcJqucrraD+ANG5Xg==',key_name='tempest-keypair-1200960086',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:40:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d7e78195df3b4c788437c1b99f9d12ce',ramdisk_id='',reservation_id='r-mxzoici8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1758002120',owner_user_name='tempest-TaggedBootDevicesTest_v242-1758002120-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='29260c50829242a5b55e6e7971d937de',uuid=4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converting VIF {"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=6dcf7900-9048-4817-bd83-53eac2e701f9,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcf7900-90') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=6dcf7900-9048-4817-bd83-53eac2e701f9,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcf7900-90') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6dcf7900-90, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ee90004b-6a1c-49a3-bb28-3ce56c74a145) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: INFO os_vif [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:05:a2,bridge_name='br-int',has_traffic_filtering=True,id=6dcf7900-9048-4817-bd83-53eac2e701f9,network=Network(3fc78920-9c30-4472-974e-d4c74b9ef6fd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6dcf7900-90')
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uZenvdFB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:49 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:49 user nova-compute[75826]: WARNING nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-84598159-131b-4f3b-8bee-97257e504831 for instance with vm_state active and task_state deleting.
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-3eb287a3-094b-4525-abd4-e60c8078ba61 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-unplugged-3eb287a3-094b-4525-abd4-e60c8078ba61 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-3eb287a3-094b-4525-abd4-e60c8078ba61 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-3eb287a3-094b-4525-abd4-e60c8078ba61 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-3eb287a3-094b-4525-abd4-e60c8078ba61 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:49 user nova-compute[75826]: WARNING nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-3eb287a3-094b-4525-abd4-e60c8078ba61 for instance with vm_state active and task_state deleting.
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-e2489a9a-e276-4520-8812-f00178685319 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-unplugged-e2489a9a-e276-4520-8812-f00178685319 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-e2489a9a-e276-4520-8812-f00178685319 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-e2489a9a-e276-4520-8812-f00178685319 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-e2489a9a-e276-4520-8812-f00178685319 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:49 user nova-compute[75826]: WARNING nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-e2489a9a-e276-4520-8812-f00178685319 for instance with vm_state active and task_state deleting.
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-unplugged-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:49 user nova-compute[75826]: WARNING nova.compute.manager [req-fbf979ec-e970-484e-9024-5a8d62675b2f req-495890a8-494c-4615-a3f9-7bbc521eaf9d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 for instance with vm_state active and task_state deleting.
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '23338393733663037', 'path': '/dev/sdf'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338393733663037', 'path': '/dev/sdf'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.303s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-8c765ac0-c657-4339-bd26-a7e5156efc55 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-8c765ac0-c657-4339-bd26-a7e5156efc55 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:49 user nova-compute[75826]: WARNING nova.compute.manager [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-8c765ac0-c657-4339-bd26-a7e5156efc55 for instance with vm_state active and task_state deleting.
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-3b998d5a-b393-40c4-aeaf-864d935daafb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-unplugged-3b998d5a-b393-40c4-aeaf-864d935daafb {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-3b998d5a-b393-40c4-aeaf-864d935daafb for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-3b998d5a-b393-40c4-aeaf-864d935daafb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-3b998d5a-b393-40c4-aeaf-864d935daafb {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:49 user nova-compute[75826]: WARNING nova.compute.manager [req-600b509a-81f3-4acc-8812-55d27d25bc50 req-4cf6aa00-69ef-466f-8669-b0ef0298ee0f service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-3b998d5a-b393-40c4-aeaf-864d935daafb for instance with vm_state active and task_state deleting.
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4b4fda-6c02-4867-a2cd-c9ccddc5b331]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:41:49 user nova-compute[75826]: No targets found.
Nov 16 00:41:49 user nova-compute[75826]: iSNS:
Nov 16 00:41:49 user nova-compute[75826]: No targets found.
Nov 16 00:41:49 user nova-compute[75826]: STATIC:
Nov 16 00:41:49 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632
Nov 16 00:41:49 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:49 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:49 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204
Nov 16 00:41:49 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:49 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:49 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf
Nov 16 00:41:49 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:49 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:49 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1
Nov 16 00:41:49 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:49 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:49 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c
Nov 16 00:41:49 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:49 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:49 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f
Nov 16 00:41:49 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:49 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:49 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432
Nov 16 00:41:49 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:49 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:49 user nova-compute[75826]: FIRMWARE:
Nov 16 00:41:49 user nova-compute[75826]: No targets found.
Nov 16 00:41:49 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:41:49 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:41:49 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T00:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-282460160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1379364694',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCXS8mfCk4vTQ8KvD02SkTq5b8gadS3Dv2Lo+h6cewehr3vqpTDQTQHj0qaShguaufSxu99avO/2zXpxPkqDPHOswK5I94kwnDiKdL++s2lPV/rz6rgG0dXcQu0zhVySw==',key_name='tempest-keypair-1471744927',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b28d760459a430b9116e57172e64a77',ramdisk_id='',reservation_id='r-qvs9it1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1015349843',owner_user_name='tempest-ServerActionsV293TestJSON-1015349843-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44daf19202c4460a56205d614f05118',uuid=33f2b149-1951-44d0-a65a-018316b31712,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Converting VIF {"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:41:49 user nova-compute[75826]:   <uuid>33f2b149-1951-44d0-a65a-018316b31712</uuid>
Nov 16 00:41:49 user nova-compute[75826]:   <name>instance-00000008</name>
Nov 16 00:41:49 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:41:49 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:41:49 user nova-compute[75826]:   <metadata>
Nov 16 00:41:49 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:41:49 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:41:49 user nova-compute[75826]:       <nova:name>tempest-ServerActionsV293TestJSON-server-282460160</nova:name>
Nov 16 00:41:49 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:41:48</nova:creationTime>
Nov 16 00:41:49 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:41:49 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:41:49 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:41:49 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:41:49 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:41:49 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:41:49 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:41:49 user nova-compute[75826]:       <nova:owner>
Nov 16 00:41:49 user nova-compute[75826]:         <nova:user uuid="d44daf19202c4460a56205d614f05118">tempest-ServerActionsV293TestJSON-1015349843-project-member</nova:user>
Nov 16 00:41:49 user nova-compute[75826]:         <nova:project uuid="7b28d760459a430b9116e57172e64a77">tempest-ServerActionsV293TestJSON-1015349843</nova:project>
Nov 16 00:41:49 user nova-compute[75826]:       </nova:owner>
Nov 16 00:41:49 user nova-compute[75826]:       <nova:ports>
Nov 16 00:41:49 user nova-compute[75826]:         <nova:port uuid="a3083677-00f2-46e4-be46-fe34b463d6a4">
Nov 16 00:41:49 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:41:49 user nova-compute[75826]:         </nova:port>
Nov 16 00:41:49 user nova-compute[75826]:       </nova:ports>
Nov 16 00:41:49 user nova-compute[75826]:     </nova:instance>
Nov 16 00:41:49 user nova-compute[75826]:   </metadata>
Nov 16 00:41:49 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:41:49 user nova-compute[75826]:     <system>
Nov 16 00:41:49 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:41:49 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:41:49 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:41:49 user nova-compute[75826]:       <entry name="serial">33f2b149-1951-44d0-a65a-018316b31712</entry>
Nov 16 00:41:49 user nova-compute[75826]:       <entry name="uuid">33f2b149-1951-44d0-a65a-018316b31712</entry>
Nov 16 00:41:49 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:41:49 user nova-compute[75826]:     </system>
Nov 16 00:41:49 user nova-compute[75826]:   </sysinfo>
Nov 16 00:41:49 user nova-compute[75826]:   <os>
Nov 16 00:41:49 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:41:49 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:41:49 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:41:49 user nova-compute[75826]:   </os>
Nov 16 00:41:49 user nova-compute[75826]:   <features>
Nov 16 00:41:49 user nova-compute[75826]:     <acpi/>
Nov 16 00:41:49 user nova-compute[75826]:     <apic/>
Nov 16 00:41:49 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:41:49 user nova-compute[75826]:   </features>
Nov 16 00:41:49 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:41:49 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:41:49 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:41:49 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:41:49 user nova-compute[75826]:   </clock>
Nov 16 00:41:49 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:41:49 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:41:49 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:41:49 user nova-compute[75826]:   </cpu>
Nov 16 00:41:49 user nova-compute[75826]:   <devices>
Nov 16 00:41:49 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:41:49 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:41:49 user nova-compute[75826]:       <source dev="/dev/sdf"/>
Nov 16 00:41:49 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:41:49 user nova-compute[75826]:       <serial>ef9dbcbd-3c51-40de-bfc8-4519b8543632</serial>
Nov 16 00:41:49 user nova-compute[75826]:     </disk>
Nov 16 00:41:49 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:41:49 user nova-compute[75826]:       <mac address="fa:16:3e:e2:5d:c2"/>
Nov 16 00:41:49 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:41:49 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:41:49 user nova-compute[75826]:       <target dev="tapa3083677-00"/>
Nov 16 00:41:49 user nova-compute[75826]:     </interface>
Nov 16 00:41:49 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:41:49 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/33f2b149-1951-44d0-a65a-018316b31712/console.log" append="off"/>
Nov 16 00:41:49 user nova-compute[75826]:     </serial>
Nov 16 00:41:49 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:41:49 user nova-compute[75826]:     <video>
Nov 16 00:41:49 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:41:49 user nova-compute[75826]:     </video>
Nov 16 00:41:49 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:41:49 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:41:49 user nova-compute[75826]:     </rng>
Nov 16 00:41:49 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:41:49 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:41:49 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:41:49 user nova-compute[75826]:     </memballoon>
Nov 16 00:41:49 user nova-compute[75826]:   </devices>
Nov 16 00:41:49 user nova-compute[75826]: </domain>
Nov 16 00:41:49 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T00:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-282460160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1379364694',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCXS8mfCk4vTQ8KvD02SkTq5b8gadS3Dv2Lo+h6cewehr3vqpTDQTQHj0qaShguaufSxu99avO/2zXpxPkqDPHOswK5I94kwnDiKdL++s2lPV/rz6rgG0dXcQu0zhVySw==',key_name='tempest-keypair-1471744927',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7b28d760459a430b9116e57172e64a77',ramdisk_id='',reservation_id='r-qvs9it1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1015349843',owner_user_name='tempest-ServerActionsV293TestJSON-1015349843-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:41:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44daf19202c4460a56205d614f05118',uuid=33f2b149-1951-44d0-a65a-018316b31712,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Converting VIF {"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_vif [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c0f501-ecc8-4040-bcec-af28094fc2fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb372929-5ede-55dc-a390-7129e805063c', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3083677-00, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3083677-00, col_values=(('qos', UUID('4a22f5ce-22c3-4fe5-b95f-e70eeecfee53')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3083677-00, col_values=(('external_ids', {'iface-id': 'a3083677-00f2-46e4-be46-fe34b463d6a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:5d:c2', 'vm-uuid': '33f2b149-1951-44d0-a65a-018316b31712'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:49 user nova-compute[75826]: INFO os_vif [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00')
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ad8da5-1192-493b-a6fd-2fbddfc05454]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:49 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:49 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:49 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:49 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:49 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:49 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:49 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:49 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:49 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:49 user nova-compute[75826]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf (non-flash)
Nov 16 00:41:49 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:49 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:49 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:49 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdbc2c7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf'): ({'sdc'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Removing single pathed devices sdc {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ec54db-aaba-4f1a-9d22-922f0a36a415]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] No VIF found with MAC fa:16:3e:e2:5d:c2, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc78eaf-35be-41d9-bdb5-8dd50f1a0c1f]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Flushing IO for device /dev/sdc {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0808cec0-d7be-42f2-90df-00035de1bd3c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffda3ab-d1bf-4308-af70-83584ae37c09]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e0b20b1-34ee-468f-945a-c5cde1399fe4]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2d04ff-1039-4474-8887-62bacde2439a]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf, portal: 172.16.0.220,3260]
Nov 16 00:41:50 user nova-compute[75826]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bfd5899f-44e0-42bc-bd1d-b986c55a05bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a6b3c1-5b24-4c50-8387-c671cf093bfd]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] <== disconnect_volume: return (648ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sVzwNjTW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:50 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ee3c0f-eef0-4de2-ba50-571981de6067]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:41:50 user nova-compute[75826]: No targets found.
Nov 16 00:41:50 user nova-compute[75826]: iSNS:
Nov 16 00:41:50 user nova-compute[75826]: No targets found.
Nov 16 00:41:50 user nova-compute[75826]: STATIC:
Nov 16 00:41:50 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632
Nov 16 00:41:50 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:50 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:50 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204
Nov 16 00:41:50 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:50 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:50 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1
Nov 16 00:41:50 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:50 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:50 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c
Nov 16 00:41:50 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:50 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:50 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f
Nov 16 00:41:50 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:50 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:50 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432
Nov 16 00:41:50 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:50 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:50 user nova-compute[75826]: FIRMWARE:
Nov 16 00:41:50 user nova-compute[75826]: No targets found.
Nov 16 00:41:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:41:50 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:41:50 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cc0cb0-37e1-4c18-b189-ed558b3e1a31]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec76e6b-23e2-440d-a949-cf93461b97c8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdbc2c7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432'): ({'sdd'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Removing single pathed devices sdd {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2547b6-e92a-48b0-8109-726976380e23]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fd226f-4e64-44d7-83b7-0397926f0e64]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Flushing IO for device /dev/sdd {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.011s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3405981-d1da-4ede-9417-8ab945444ba5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[25301a70-39cf-4f9a-893d-67a1ad6da31c]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a4aca01-e471-4e94-8e30-f72794a2871b]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[642d3774-7915-446e-bb29-ccbe0c875133]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432, portal: 172.16.0.220,3260]
Nov 16 00:41:50 user nova-compute[75826]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0fc7afe-aebe-48c1-b550-3af8eacea432 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f11cf4-f5d2-48a4-be98-47fbcae02767]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] <== disconnect_volume: return (317ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ANJyzeVY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:50 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[383ed44b-7880-409f-9497-e85dc313f499]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:41:50 user nova-compute[75826]: No targets found.
Nov 16 00:41:50 user nova-compute[75826]: iSNS:
Nov 16 00:41:50 user nova-compute[75826]: No targets found.
Nov 16 00:41:50 user nova-compute[75826]: STATIC:
Nov 16 00:41:50 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632
Nov 16 00:41:50 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:50 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:50 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204
Nov 16 00:41:50 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:50 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:50 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1
Nov 16 00:41:50 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:50 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:50 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c
Nov 16 00:41:50 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:50 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:50 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f
Nov 16 00:41:50 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:50 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:50 user nova-compute[75826]: FIRMWARE:
Nov 16 00:41:50 user nova-compute[75826]: No targets found.
Nov 16 00:41:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:41:50 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:41:50 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[395a13e7-a30d-4f09-9f0a-cd931a9ab922]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b53d3920-1dcf-41ac-bf7e-2b5917684662]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c (non-flash)
Nov 16 00:41:50 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdbc2c7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c'): ({'sde'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Removing single pathed devices sde {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e68054-33b5-46c7-8dc5-35258dc569a0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56c86b4-7079-4121-8f66-27d499cfecce]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Flushing IO for device /dev/sde {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62b7f7f-2724-48bf-94f0-47c22719c2f1]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b24299-8da9-4035-994f-659967b71d16]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c264f4-8204-4f53-8d10-da044e449f74]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94ff1b7-0281-40b6-a778-cfc98cffa5b0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c, portal: 172.16.0.220,3260]
Nov 16 00:41:50 user nova-compute[75826]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c82fa9f-c996-4bc7-9cf5-82f93f579e9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec963dc-1d2e-47a7-ab2c-a717cd342425]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] <== disconnect_volume: return (319ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:41:50 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Deleting instance files /opt/stack/data/nova/instances/4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d_del
Nov 16 00:41:50 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Deletion of /opt/stack/data/nova/instances/4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d_del complete
Nov 16 00:41:50 user nova-compute[75826]: INFO nova.compute.manager [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Took 3.79 seconds to destroy the instance on the hypervisor.
Nov 16 00:41:50 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:41:50 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-a13fc774-335a-468c-88be-5827cff55af4 req-bd7d17da-90e2-4b4f-9545-9fa518a106c3 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received event network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a13fc774-335a-468c-88be-5827cff55af4 req-bd7d17da-90e2-4b4f-9545-9fa518a106c3 service nova] Acquiring lock "33f2b149-1951-44d0-a65a-018316b31712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a13fc774-335a-468c-88be-5827cff55af4 req-bd7d17da-90e2-4b4f-9545-9fa518a106c3 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a13fc774-335a-468c-88be-5827cff55af4 req-bd7d17da-90e2-4b4f-9545-9fa518a106c3 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-a13fc774-335a-468c-88be-5827cff55af4 req-bd7d17da-90e2-4b4f-9545-9fa518a106c3 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] No waiting events found dispatching network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:51 user nova-compute[75826]: WARNING nova.compute.manager [req-a13fc774-335a-468c-88be-5827cff55af4 req-bd7d17da-90e2-4b4f-9545-9fa518a106c3 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received unexpected event network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 00:41:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-efc3303f-513e-429e-a809-eae19ab1b7d9 req-c3155ff7-ece5-4084-8445-2df7086e62d2 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-6dcf7900-9048-4817-bd83-53eac2e701f9 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-efc3303f-513e-429e-a809-eae19ab1b7d9 req-c3155ff7-ece5-4084-8445-2df7086e62d2 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-efc3303f-513e-429e-a809-eae19ab1b7d9 req-c3155ff7-ece5-4084-8445-2df7086e62d2 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-efc3303f-513e-429e-a809-eae19ab1b7d9 req-c3155ff7-ece5-4084-8445-2df7086e62d2 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-efc3303f-513e-429e-a809-eae19ab1b7d9 req-c3155ff7-ece5-4084-8445-2df7086e62d2 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-unplugged-6dcf7900-9048-4817-bd83-53eac2e701f9 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-efc3303f-513e-429e-a809-eae19ab1b7d9 req-c3155ff7-ece5-4084-8445-2df7086e62d2 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-unplugged-6dcf7900-9048-4817-bd83-53eac2e701f9 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-efc3303f-513e-429e-a809-eae19ab1b7d9 req-c3155ff7-ece5-4084-8445-2df7086e62d2 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-plugged-6dcf7900-9048-4817-bd83-53eac2e701f9 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-efc3303f-513e-429e-a809-eae19ab1b7d9 req-c3155ff7-ece5-4084-8445-2df7086e62d2 service nova] Acquiring lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-efc3303f-513e-429e-a809-eae19ab1b7d9 req-c3155ff7-ece5-4084-8445-2df7086e62d2 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-efc3303f-513e-429e-a809-eae19ab1b7d9 req-c3155ff7-ece5-4084-8445-2df7086e62d2 service nova] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-efc3303f-513e-429e-a809-eae19ab1b7d9 req-c3155ff7-ece5-4084-8445-2df7086e62d2 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] No waiting events found dispatching network-vif-plugged-6dcf7900-9048-4817-bd83-53eac2e701f9 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:51 user nova-compute[75826]: WARNING nova.compute.manager [req-efc3303f-513e-429e-a809-eae19ab1b7d9 req-c3155ff7-ece5-4084-8445-2df7086e62d2 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received unexpected event network-vif-plugged-6dcf7900-9048-4817-bd83-53eac2e701f9 for instance with vm_state active and task_state deleting.
Nov 16 00:41:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:52 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 8946e093-6440-479f-95bc-c65391b9d2ba is timed out.
Nov 16 00:41:52 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Successfully detached device sdc from instance 8946e093-6440-479f-95bc-c65391b9d2ba from the live domain config.
Nov 16 00:41:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jxYbBLap', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:52 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[552a00cd-920a-4756-9cd4-a48a320400c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:41:52 user nova-compute[75826]: No targets found.
Nov 16 00:41:52 user nova-compute[75826]: iSNS:
Nov 16 00:41:52 user nova-compute[75826]: No targets found.
Nov 16 00:41:52 user nova-compute[75826]: STATIC:
Nov 16 00:41:52 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632
Nov 16 00:41:52 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:52 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:52 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204
Nov 16 00:41:52 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:52 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:52 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1
Nov 16 00:41:52 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:52 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:52 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f
Nov 16 00:41:52 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:52 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:52 user nova-compute[75826]: FIRMWARE:
Nov 16 00:41:52 user nova-compute[75826]: No targets found.
Nov 16 00:41:52 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:41:52 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:41:52 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8466baac-e9c8-4481-9eab-cdcb99c6c781]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f7fc1a-b036-499c-accf-e622d307c72d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:52 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:52 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:52 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:52 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:52 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:52 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:52 user nova-compute[75826]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 (non-flash)
Nov 16 00:41:52 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb475f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1'): ({'sdb'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Removing single pathed devices sdb {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:41:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6205cd-1b04-4876-b639-3fbe8006e572]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35ba9f8-c07f-4a87-aaaf-538ebc5c9086]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Flushing IO for device /dev/sdb {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1a6ae3-4796-4c1a-a080-f52751159756]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e0cf4a-69c4-46be-887a-4b756e023706]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bad382-66fa-4689-bb0d-34ec7f7b5c84]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1990a9-dbc7-4e73-bdf2-b2e4fd565af2]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1, portal: 172.16.0.220,3260]
Nov 16 00:41:53 user nova-compute[75826]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:53 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:171e9f14-a3dc-4b65-99cc-5dceaa8d4db1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13ae79c-2089-4d8f-a179-68bfc6829afe]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] <== disconnect_volume: return (315ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:41:53 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Instance spawned successfully.
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-9241829e-f864-4dd1-bcd4-49a12d600978 req-aaaf8f80-ba60-4650-adc3-efcad1b8fa62 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received event network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9241829e-f864-4dd1-bcd4-49a12d600978 req-aaaf8f80-ba60-4650-adc3-efcad1b8fa62 service nova] Acquiring lock "33f2b149-1951-44d0-a65a-018316b31712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9241829e-f864-4dd1-bcd4-49a12d600978 req-aaaf8f80-ba60-4650-adc3-efcad1b8fa62 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9241829e-f864-4dd1-bcd4-49a12d600978 req-aaaf8f80-ba60-4650-adc3-efcad1b8fa62 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-9241829e-f864-4dd1-bcd4-49a12d600978 req-aaaf8f80-ba60-4650-adc3-efcad1b8fa62 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] No waiting events found dispatching network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:53 user nova-compute[75826]: WARNING nova.compute.manager [req-9241829e-f864-4dd1-bcd4-49a12d600978 req-aaaf8f80-ba60-4650-adc3-efcad1b8fa62 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received unexpected event network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 for instance with vm_state active and task_state rebuild_spawning.
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.objects.instance [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75826) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-996c493a-cb16-4211-825d-3631af0abcd2 tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.085s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-deleted-3b998d5a-b393-40c4-aeaf-864d935daafb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:53 user nova-compute[75826]: INFO nova.compute.manager [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Neutron deleted interface 3b998d5a-b393-40c4-aeaf-864d935daafb; detaching it from the instance and deleting it from the info cache
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [{"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e2489a9a-e276-4520-8812-f00178685319", "address": "fa:16:3e:d6:6e:db", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2489a9a-e2", "ovs_interfaceid": "e2489a9a-e276-4520-8812-f00178685319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Detach interface failed, port_id=3b998d5a-b393-40c4-aeaf-864d935daafb, reason: Instance 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-deleted-e2489a9a-e276-4520-8812-f00178685319 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:53 user nova-compute[75826]: INFO nova.compute.manager [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Neutron deleted interface e2489a9a-e276-4520-8812-f00178685319; detaching it from the instance and deleting it from the info cache
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [{"id": "84598159-131b-4f3b-8bee-97257e504831", "address": "fa:16:3e:28:26:8e", "network": {"id": "df29f611-0f85-46dd-b62c-d751f6aca045", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-464855331-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84598159-13", "ovs_interfaceid": "84598159-131b-4f3b-8bee-97257e504831", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Detach interface failed, port_id=e2489a9a-e276-4520-8812-f00178685319, reason: Instance 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-deleted-84598159-131b-4f3b-8bee-97257e504831 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:53 user nova-compute[75826]: INFO nova.compute.manager [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Neutron deleted interface 84598159-131b-4f3b-8bee-97257e504831; detaching it from the instance and deleting it from the info cache
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [{"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6dcf7900-9048-4817-bd83-53eac2e701f9", "address": "fa:16:3e:ba:05:a2", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6dcf7900-90", "ovs_interfaceid": "6dcf7900-9048-4817-bd83-53eac2e701f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Detach interface failed, port_id=84598159-131b-4f3b-8bee-97257e504831, reason: Instance 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-deleted-6dcf7900-9048-4817-bd83-53eac2e701f9 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:53 user nova-compute[75826]: INFO nova.compute.manager [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Neutron deleted interface 6dcf7900-9048-4817-bd83-53eac2e701f9; detaching it from the instance and deleting it from the info cache
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [{"id": "3eb287a3-094b-4525-abd4-e60c8078ba61", "address": "fa:16:3e:1f:72:11", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.102", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3eb287a3-09", "ovs_interfaceid": "3eb287a3-094b-4525-abd4-e60c8078ba61", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8c765ac0-c657-4339-bd26-a7e5156efc55", "address": "fa:16:3e:db:17:e1", "network": {"id": "8eb8694d-7067-48d5-892f-d0ad33bff077", "bridge": "br-int", "label": "tempest-device-tagging-net1-550773692", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.104", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c765ac0-c6", "ovs_interfaceid": "8c765ac0-c657-4339-bd26-a7e5156efc55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "address": "fa:16:3e:37:88:66", "network": {"id": "3fc78920-9c30-4472-974e-d4c74b9ef6fd", "bridge": "br-int", "label": "tempest-device-tagging-net2-26564871", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "d7e78195df3b4c788437c1b99f9d12ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5bcc1ad-78", "ovs_interfaceid": "a5bcc1ad-78d3-4302-beca-f4e4a27dfc59", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:53 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Took 3.08 seconds to deallocate network for instance.
Nov 16 00:41:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-5ccdda70-760b-4174-81d5-b427ce84484f req-f585f698-dcec-4a8d-bd8c-450a898ff34d service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Detach interface failed, port_id=6dcf7900-9048-4817-bd83-53eac2e701f9, reason: Instance 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:41:54 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:41:54 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lazy-loading 'flavor' on Instance uuid 8946e093-6440-479f-95bc-c65391b9d2ba {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a1e7519-7633-4586-9023-1172a42119d5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "8946e093-6440-479f-95bc-c65391b9d2ba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.835s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "8946e093-6440-479f-95bc-c65391b9d2ba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "8946e093-6440-479f-95bc-c65391b9d2ba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:55 user nova-compute[75826]: INFO nova.compute.manager [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Terminating instance
Nov 16 00:41:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-ca2c90f2-2088-4073-8320-6e4310d1aca2 req-9b2b2a30-a5d7-46b0-843a-cb6e8ddb1ba6 service nova] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Received event network-vif-deleted-a5bcc1ad-78d3-4302-beca-f4e4a27dfc59 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-7f442c83-3011-4444-9e53-ebfe5dfb2599 req-1fb00d24-ca71-4315-acf1-a128dcc7e1b7 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Received event network-vif-unplugged-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7f442c83-3011-4444-9e53-ebfe5dfb2599 req-1fb00d24-ca71-4315-acf1-a128dcc7e1b7 service nova] Acquiring lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7f442c83-3011-4444-9e53-ebfe5dfb2599 req-1fb00d24-ca71-4315-acf1-a128dcc7e1b7 service nova] Lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7f442c83-3011-4444-9e53-ebfe5dfb2599 req-1fb00d24-ca71-4315-acf1-a128dcc7e1b7 service nova] Lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-7f442c83-3011-4444-9e53-ebfe5dfb2599 req-1fb00d24-ca71-4315-acf1-a128dcc7e1b7 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] No waiting events found dispatching network-vif-unplugged-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-7f442c83-3011-4444-9e53-ebfe5dfb2599 req-1fb00d24-ca71-4315-acf1-a128dcc7e1b7 service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Received event network-vif-unplugged-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:56 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Instance destroyed successfully.
Nov 16 00:41:56 user nova-compute[75826]: DEBUG nova.objects.instance [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lazy-loading 'resources' on Instance uuid 8946e093-6440-479f-95bc-c65391b9d2ba {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-308134010',display_name='tempest-AttachSCSIVolumeTestJSON-server-308134010',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-308134010',id=7,image_ref='54529057-c114-4810-8a21-ad42318af10c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAlP3S6Y1ty+raWZOVD93LwLkCZiTKDemNf55aXHYlf9JtmA6UmATNDme40n18ixRyRTurk2eR6kuA1qdIj+GCD7rzi20MUNT6tIiippnrLk0NFeLyHYLuWLzkGoT7jemg==',key_name='tempest-keypair-874873702',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='571b03a1cf0e43c28d8ca716b737c558',ramdisk_id='',reservation_id='r-vrfk8scw',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='54529057-c114-4810-8a21-ad42318af10c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-363758748',owner_user_name='tempest-AttachSCSIVolumeTestJSON-363758748-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:39:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d39be3e2d4ad4f8daec0c0927edfbd59',uuid=8946e093-6440-479f-95bc-c65391b9d2ba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "address": "fa:16:3e:bb:12:6d", "network": {"id": "e3392f0b-2086-42ef-8292-84e785b0f697", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1543909989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "571b03a1cf0e43c28d8ca716b737c558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82340bab-a0", "ovs_interfaceid": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Converting VIF {"id": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "address": "fa:16:3e:bb:12:6d", "network": {"id": "e3392f0b-2086-42ef-8292-84e785b0f697", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1543909989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.51", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "571b03a1cf0e43c28d8ca716b737c558", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82340bab-a0", "ovs_interfaceid": "82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bb:12:6d,bridge_name='br-int',has_traffic_filtering=True,id=82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86,network=Network(e3392f0b-2086-42ef-8292-84e785b0f697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82340bab-a0') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG os_vif [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:12:6d,bridge_name='br-int',has_traffic_filtering=True,id=82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86,network=Network(e3392f0b-2086-42ef-8292-84e785b0f697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82340bab-a0') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82340bab-a0, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf3b477b-9cdd-4f34-906c-d45ce98160cb) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:41:56 user nova-compute[75826]: INFO os_vif [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bb:12:6d,bridge_name='br-int',has_traffic_filtering=True,id=82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86,network=Network(e3392f0b-2086-42ef-8292-84e785b0f697),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82340bab-a0')
Nov 16 00:41:56 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Deleting instance files /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba_del
Nov 16 00:41:56 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Deletion of /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba_del complete
Nov 16 00:41:56 user nova-compute[75826]: INFO nova.compute.manager [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 16 00:41:56 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk --force-share --output=json" returned: 1 in 0.215s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk --force-share --output=json' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:41:56 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Periodic task is updating the host stats, it is trying to get disk info for instance-00000007, but the backing disk storage was removed by a concurrent operation such as resize. Error: No disk at /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk: nova.exception.DiskNotFound: No disk at /opt/stack/data/nova/instances/8946e093-6440-479f-95bc-c65391b9d2ba/disk
Nov 16 00:41:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:56 user nova-compute[75826]: INFO nova.compute.manager [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] [instance: 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d] Took 2.75 seconds to detach 3 volumes for instance.
Nov 16 00:41:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.479s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Deleted allocations for instance 4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d
Nov 16 00:41:57 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:41:57 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Took 0.93 seconds to deallocate network for instance.
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d206221e-a26b-40cd-8399-b4fbe05ffe0f tempest-TaggedBootDevicesTest_v242-1758002120 tempest-TaggedBootDevicesTest_v242-1758002120-project-member] Lock "4ce7c1de-9b34-4a9d-b5c6-4d7047b2c82d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.502s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:57 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 is timed out.
Nov 16 00:41:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Successfully detached device vdb from instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 from the live domain config.
Nov 16 00:41:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fJeKSXkE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:41:57 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20bd613-52c2-4d9d-ab6a-90f112f21f8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:41:57 user nova-compute[75826]: No targets found.
Nov 16 00:41:57 user nova-compute[75826]: iSNS:
Nov 16 00:41:57 user nova-compute[75826]: No targets found.
Nov 16 00:41:57 user nova-compute[75826]: STATIC:
Nov 16 00:41:57 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632
Nov 16 00:41:57 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:57 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:57 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204
Nov 16 00:41:57 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:57 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:57 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f
Nov 16 00:41:57 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:41:57 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:41:57 user nova-compute[75826]: FIRMWARE:
Nov 16 00:41:57 user nova-compute[75826]: No targets found.
Nov 16 00:41:57 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:41:57 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:41:57 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[981e3f40-b83a-4121-ae70-d1332ac96242]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cc851c-19ea-417c-a049-c16fedbaaf4b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:57 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:57 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:57 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 (non-flash)
Nov 16 00:41:57 user nova-compute[75826]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:41:57 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:41:57 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb45c41f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204'): ({'sdh'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Removing single pathed devices sdh {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c870af3-b8d4-4b34-b6ac-6d1442c62d8c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44c130f-2248-47eb-98cc-5df13cf14ac9]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Flushing IO for device /dev/sdh {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-d644f3cb-5247-47ee-be62-2694e5192be3 req-b02683b9-094f-4d24-b2a5-7975c34ef37f service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Received event network-vif-deleted-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a68853-9d96-4ade-8a7c-9cf48c3f3f5e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9602007b-4c2a-460a-b694-6792fdaba426]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] SCSI volumes sdh have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1acba9-0df1-4904-b087-2f23baed15e9]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:41:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-52536296-d206-496f-ae07-1bcb3981ffcc req-e98cd9d3-11fb-429d-bb9a-509a711c708d service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Received event network-vif-plugged-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-52536296-d206-496f-ae07-1bcb3981ffcc req-e98cd9d3-11fb-429d-bb9a-509a711c708d service nova] Acquiring lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-52536296-d206-496f-ae07-1bcb3981ffcc req-e98cd9d3-11fb-429d-bb9a-509a711c708d service nova] Lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-52536296-d206-496f-ae07-1bcb3981ffcc req-e98cd9d3-11fb-429d-bb9a-509a711c708d service nova] Lock "8946e093-6440-479f-95bc-c65391b9d2ba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-52536296-d206-496f-ae07-1bcb3981ffcc req-e98cd9d3-11fb-429d-bb9a-509a711c708d service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] No waiting events found dispatching network-vif-plugged-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:41:58 user nova-compute[75826]: WARNING nova.compute.manager [req-52536296-d206-496f-ae07-1bcb3981ffcc req-e98cd9d3-11fb-429d-bb9a-509a711c708d service nova] [instance: 8946e093-6440-479f-95bc-c65391b9d2ba] Received unexpected event network-vif-plugged-82340bab-a0a2-4d9c-8fc9-ac7dc2b96a86 for instance with vm_state deleted and task_state None.
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[448bbdf0-636f-4b26-893c-805636e8bb97]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204, portal: 172.16.0.220,3260]
Nov 16 00:41:58 user nova-compute[75826]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204, portal: 172.16.0.220,3260] successful.
Nov 16 00:41:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5a4a669b-5e9d-4dc3-81a9-b5044f358204 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5da4068-8032-4b14-9c10-14c9ed3bcd4d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.441s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] <== disconnect_volume: return (443ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.556s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:58 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Deleted allocations for instance 8946e093-6440-479f-95bc-c65391b9d2ba
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5d687ac1-0405-4515-aa27-38571406bbe5 tempest-AttachSCSIVolumeTestJSON-363758748 tempest-AttachSCSIVolumeTestJSON-363758748-project-member] Lock "8946e093-6440-479f-95bc-c65391b9d2ba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.873s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:41:58 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lazy-loading 'flavor' on Instance uuid 203da1ce-e5b1-4a16-a75e-e934c68d6e68 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:59 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:41:59 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7457MB free_disk=25.635643005371094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c5023d5e-d001-47f4-b848-7fc57cdeaa3d tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.280s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance d9ac6719-80f7-490a-a51e-869b51118aa2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 33f2b149-1951-44d0-a65a-018316b31712 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "interface-203da1ce-e5b1-4a16-a75e-e934c68d6e68-3ed8b208-8715-4d4b-8be5-7ad437342e88" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "interface-203da1ce-e5b1-4a16-a75e-e934c68d6e68-3ed8b208-8715-4d4b-8be5-7ad437342e88" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lazy-loading 'flavor' on Instance uuid 203da1ce-e5b1-4a16-a75e-e934c68d6e68 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73313562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73313562',id=9,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcxgQNIwtABwmWWY66lpLW4FahMujB4sq8+awLbY3j4T0F+WRfv6pOgZdlOEfsFFgqQNg0M3KAfXMF/9LBbJOCDmKtj5c59DNwM9T0+YoH3Fun1L1tu/xueB5ab2B1nPg==',key_name='tempest-keypair-1839588636',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e313a75f9fc4e91b5866d0228336b0b',ramdisk_id='',reservation_id='r-1vf0ms0c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2144441547',owner_user_name='tempest-TaggedAttachmentsTest-2144441547-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:39:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='159de45699cb47c68211051c7f62dae4',uuid=203da1ce-e5b1-4a16-a75e-e934c68d6e68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converting VIF {"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed8b208-8715-4d4b-8be5-7ad437342e88,network=Network(bc4cb393-8a3e-4322-8f51-fc958631055d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed8b208-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:26:dd:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap3ed8b208-87"/></interface> {{(pid=75826) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:26:dd:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap3ed8b208-87"/></interface> {{(pid=75826) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Attempting to detach device tap3ed8b208-87 from instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] detach device xml: <interface type="ethernet">
Nov 16 00:41:59 user nova-compute[75826]:   <mac address="fa:16:3e:26:dd:4c"/>
Nov 16 00:41:59 user nova-compute[75826]:   <model type="virtio"/>
Nov 16 00:41:59 user nova-compute[75826]:   <mtu size="1442"/>
Nov 16 00:41:59 user nova-compute[75826]:   <target dev="tap3ed8b208-87"/>
Nov 16 00:41:59 user nova-compute[75826]: </interface>
Nov 16 00:41:59 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:26:dd:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap3ed8b208-87"/></interface> {{(pid=75826) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:26:dd:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap3ed8b208-87"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 16 00:41:59 user nova-compute[75826]:   <name>instance-00000009</name>
Nov 16 00:41:59 user nova-compute[75826]:   <uuid>203da1ce-e5b1-4a16-a75e-e934c68d6e68</uuid>
Nov 16 00:41:59 user nova-compute[75826]:   <metadata>
Nov 16 00:41:59 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:41:59 user nova-compute[75826]:   <nova:package version="0.0.0"/>
Nov 16 00:41:59 user nova-compute[75826]:   <nova:name>tempest-device-tagging-server-73313562</nova:name>
Nov 16 00:41:59 user nova-compute[75826]:   <nova:creationTime>2023-11-16 00:41:28</nova:creationTime>
Nov 16 00:41:59 user nova-compute[75826]:   <nova:flavor name="m1.tiny">
Nov 16 00:41:59 user nova-compute[75826]:     <nova:memory>512</nova:memory>
Nov 16 00:41:59 user nova-compute[75826]:     <nova:disk>1</nova:disk>
Nov 16 00:41:59 user nova-compute[75826]:     <nova:swap>0</nova:swap>
Nov 16 00:41:59 user nova-compute[75826]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:41:59 user nova-compute[75826]:     <nova:vcpus>1</nova:vcpus>
Nov 16 00:41:59 user nova-compute[75826]:   </nova:flavor>
Nov 16 00:41:59 user nova-compute[75826]:   <nova:owner>
Nov 16 00:41:59 user nova-compute[75826]:     <nova:user uuid="159de45699cb47c68211051c7f62dae4">tempest-TaggedAttachmentsTest-2144441547-project-member</nova:user>
Nov 16 00:41:59 user nova-compute[75826]:     <nova:project uuid="6e313a75f9fc4e91b5866d0228336b0b">tempest-TaggedAttachmentsTest-2144441547</nova:project>
Nov 16 00:41:59 user nova-compute[75826]:   </nova:owner>
Nov 16 00:41:59 user nova-compute[75826]:   <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:41:59 user nova-compute[75826]:   <nova:ports>
Nov 16 00:41:59 user nova-compute[75826]:     <nova:port uuid="ebabaf39-8f6c-4790-b555-271d5aef9db8">
Nov 16 00:41:59 user nova-compute[75826]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:41:59 user nova-compute[75826]:     </nova:port>
Nov 16 00:41:59 user nova-compute[75826]:     <nova:port uuid="3ed8b208-8715-4d4b-8be5-7ad437342e88">
Nov 16 00:41:59 user nova-compute[75826]:       <nova:ip type="fixed" address="10.10.10.194" ipVersion="4"/>
Nov 16 00:41:59 user nova-compute[75826]:     </nova:port>
Nov 16 00:41:59 user nova-compute[75826]:   </nova:ports>
Nov 16 00:41:59 user nova-compute[75826]: </nova:instance>
Nov 16 00:41:59 user nova-compute[75826]:   </metadata>
Nov 16 00:41:59 user nova-compute[75826]:   <memory unit='KiB'>524288</memory>
Nov 16 00:41:59 user nova-compute[75826]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 00:41:59 user nova-compute[75826]:   <vcpu placement='static'>1</vcpu>
Nov 16 00:41:59 user nova-compute[75826]:   <resource>
Nov 16 00:41:59 user nova-compute[75826]:     <partition>/machine</partition>
Nov 16 00:41:59 user nova-compute[75826]:   </resource>
Nov 16 00:41:59 user nova-compute[75826]:   <sysinfo type='smbios'>
Nov 16 00:41:59 user nova-compute[75826]:     <system>
Nov 16 00:41:59 user nova-compute[75826]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 00:41:59 user nova-compute[75826]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 00:41:59 user nova-compute[75826]:       <entry name='version'>0.0.0</entry>
Nov 16 00:41:59 user nova-compute[75826]:       <entry name='serial'>203da1ce-e5b1-4a16-a75e-e934c68d6e68</entry>
Nov 16 00:41:59 user nova-compute[75826]:       <entry name='uuid'>203da1ce-e5b1-4a16-a75e-e934c68d6e68</entry>
Nov 16 00:41:59 user nova-compute[75826]:       <entry name='family'>Virtual Machine</entry>
Nov 16 00:41:59 user nova-compute[75826]:     </system>
Nov 16 00:41:59 user nova-compute[75826]:   </sysinfo>
Nov 16 00:41:59 user nova-compute[75826]:   <os>
Nov 16 00:41:59 user nova-compute[75826]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 00:41:59 user nova-compute[75826]:     <boot dev='hd'/>
Nov 16 00:41:59 user nova-compute[75826]:     <smbios mode='sysinfo'/>
Nov 16 00:41:59 user nova-compute[75826]:   </os>
Nov 16 00:41:59 user nova-compute[75826]:   <features>
Nov 16 00:41:59 user nova-compute[75826]:     <acpi/>
Nov 16 00:41:59 user nova-compute[75826]:     <apic/>
Nov 16 00:41:59 user nova-compute[75826]:     <vmcoreinfo state='on'/>
Nov 16 00:41:59 user nova-compute[75826]:   </features>
Nov 16 00:41:59 user nova-compute[75826]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 00:41:59 user nova-compute[75826]:     <model fallback='forbid'>Nehalem</model>
Nov 16 00:41:59 user nova-compute[75826]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 00:41:59 user nova-compute[75826]:     <feature policy='require' name='vme'/>
Nov 16 00:41:59 user nova-compute[75826]:     <feature policy='require' name='x2apic'/>
Nov 16 00:41:59 user nova-compute[75826]:     <feature policy='require' name='hypervisor'/>
Nov 16 00:41:59 user nova-compute[75826]:   </cpu>
Nov 16 00:41:59 user nova-compute[75826]:   <clock offset='utc'>
Nov 16 00:41:59 user nova-compute[75826]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 00:41:59 user nova-compute[75826]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 00:41:59 user nova-compute[75826]:     <timer name='hpet' present='no'/>
Nov 16 00:41:59 user nova-compute[75826]:   </clock>
Nov 16 00:41:59 user nova-compute[75826]:   <on_poweroff>destroy</on_poweroff>
Nov 16 00:41:59 user nova-compute[75826]:   <on_reboot>restart</on_reboot>
Nov 16 00:41:59 user nova-compute[75826]:   <on_crash>destroy</on_crash>
Nov 16 00:41:59 user nova-compute[75826]:   <devices>
Nov 16 00:41:59 user nova-compute[75826]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 00:41:59 user nova-compute[75826]:     <disk type='file' device='disk'>
Nov 16 00:41:59 user nova-compute[75826]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 00:41:59 user nova-compute[75826]:       <source file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk' index='2'/>
Nov 16 00:41:59 user nova-compute[75826]:       <backingStore type='file' index='3'>
Nov 16 00:41:59 user nova-compute[75826]:         <format type='raw'/>
Nov 16 00:41:59 user nova-compute[75826]:         <source file='/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e'/>
Nov 16 00:41:59 user nova-compute[75826]:         <backingStore/>
Nov 16 00:41:59 user nova-compute[75826]:       </backingStore>
Nov 16 00:41:59 user nova-compute[75826]:       <target dev='vda' bus='virtio'/>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='virtio-disk0'/>
Nov 16 00:41:59 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 00:41:59 user nova-compute[75826]:     </disk>
Nov 16 00:41:59 user nova-compute[75826]:     <disk type='file' device='cdrom'>
Nov 16 00:41:59 user nova-compute[75826]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 00:41:59 user nova-compute[75826]:       <source file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk.config' index='1'/>
Nov 16 00:41:59 user nova-compute[75826]:       <backingStore/>
Nov 16 00:41:59 user nova-compute[75826]:       <target dev='hda' bus='ide'/>
Nov 16 00:41:59 user nova-compute[75826]:       <readonly/>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='ide0-0-0'/>
Nov 16 00:41:59 user nova-compute[75826]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 00:41:59 user nova-compute[75826]:     </disk>
Nov 16 00:41:59 user nova-compute[75826]:     <controller type='usb' index='0' model='none'>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='usb'/>
Nov 16 00:41:59 user nova-compute[75826]:     </controller>
Nov 16 00:41:59 user nova-compute[75826]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='pci.0'/>
Nov 16 00:41:59 user nova-compute[75826]:     </controller>
Nov 16 00:41:59 user nova-compute[75826]:     <controller type='ide' index='0'>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='ide'/>
Nov 16 00:41:59 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 00:41:59 user nova-compute[75826]:     </controller>
Nov 16 00:41:59 user nova-compute[75826]:     <interface type='ethernet'>
Nov 16 00:41:59 user nova-compute[75826]:       <mac address='fa:16:3e:d3:17:39'/>
Nov 16 00:41:59 user nova-compute[75826]:       <target dev='tapebabaf39-8f'/>
Nov 16 00:41:59 user nova-compute[75826]:       <model type='virtio'/>
Nov 16 00:41:59 user nova-compute[75826]:       <mtu size='1442'/>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='net0'/>
Nov 16 00:41:59 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 00:41:59 user nova-compute[75826]:     </interface>
Nov 16 00:41:59 user nova-compute[75826]:     <interface type='ethernet'>
Nov 16 00:41:59 user nova-compute[75826]:       <mac address='fa:16:3e:26:dd:4c'/>
Nov 16 00:41:59 user nova-compute[75826]:       <target dev='tap3ed8b208-87'/>
Nov 16 00:41:59 user nova-compute[75826]:       <model type='virtio'/>
Nov 16 00:41:59 user nova-compute[75826]:       <mtu size='1442'/>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='net1'/>
Nov 16 00:41:59 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 16 00:41:59 user nova-compute[75826]:     </interface>
Nov 16 00:41:59 user nova-compute[75826]:     <serial type='pty'>
Nov 16 00:41:59 user nova-compute[75826]:       <source path='/dev/pts/7'/>
Nov 16 00:41:59 user nova-compute[75826]:       <log file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/console.log' append='off'/>
Nov 16 00:41:59 user nova-compute[75826]:       <target type='isa-serial' port='0'>
Nov 16 00:41:59 user nova-compute[75826]:         <model name='isa-serial'/>
Nov 16 00:41:59 user nova-compute[75826]:       </target>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='serial0'/>
Nov 16 00:41:59 user nova-compute[75826]:     </serial>
Nov 16 00:41:59 user nova-compute[75826]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 00:41:59 user nova-compute[75826]:       <source path='/dev/pts/7'/>
Nov 16 00:41:59 user nova-compute[75826]:       <log file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/console.log' append='off'/>
Nov 16 00:41:59 user nova-compute[75826]:       <target type='serial' port='0'/>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='serial0'/>
Nov 16 00:41:59 user nova-compute[75826]:     </console>
Nov 16 00:41:59 user nova-compute[75826]:     <input type='mouse' bus='ps2'>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='input0'/>
Nov 16 00:41:59 user nova-compute[75826]:     </input>
Nov 16 00:41:59 user nova-compute[75826]:     <input type='keyboard' bus='ps2'>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='input1'/>
Nov 16 00:41:59 user nova-compute[75826]:     </input>
Nov 16 00:41:59 user nova-compute[75826]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 16 00:41:59 user nova-compute[75826]:       <listen type='address' address='0.0.0.0'/>
Nov 16 00:41:59 user nova-compute[75826]:     </graphics>
Nov 16 00:41:59 user nova-compute[75826]:     <audio id='1' type='none'/>
Nov 16 00:41:59 user nova-compute[75826]:     <video>
Nov 16 00:41:59 user nova-compute[75826]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='video0'/>
Nov 16 00:41:59 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 00:41:59 user nova-compute[75826]:     </video>
Nov 16 00:41:59 user nova-compute[75826]:     <memballoon model='virtio'>
Nov 16 00:41:59 user nova-compute[75826]:       <stats period='10'/>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='balloon0'/>
Nov 16 00:41:59 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 00:41:59 user nova-compute[75826]:     </memballoon>
Nov 16 00:41:59 user nova-compute[75826]:     <rng model='virtio'>
Nov 16 00:41:59 user nova-compute[75826]:       <backend model='random'>/dev/urandom</backend>
Nov 16 00:41:59 user nova-compute[75826]:       <alias name='rng0'/>
Nov 16 00:41:59 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 00:41:59 user nova-compute[75826]:     </rng>
Nov 16 00:41:59 user nova-compute[75826]:   </devices>
Nov 16 00:41:59 user nova-compute[75826]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 00:41:59 user nova-compute[75826]:     <label>libvirt-203da1ce-e5b1-4a16-a75e-e934c68d6e68</label>
Nov 16 00:41:59 user nova-compute[75826]:     <imagelabel>libvirt-203da1ce-e5b1-4a16-a75e-e934c68d6e68</imagelabel>
Nov 16 00:41:59 user nova-compute[75826]:   </seclabel>
Nov 16 00:41:59 user nova-compute[75826]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 00:41:59 user nova-compute[75826]:     <label>+64055:+108</label>
Nov 16 00:41:59 user nova-compute[75826]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 00:41:59 user nova-compute[75826]:   </seclabel>
Nov 16 00:41:59 user nova-compute[75826]: </domain>
Nov 16 00:41:59 user nova-compute[75826]:  {{(pid=75826) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 00:41:59 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Successfully detached device tap3ed8b208-87 from instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 from the persistent domain config.
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] (1/8): Attempting to detach device tap3ed8b208-87 with device alias net1 from instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:41:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] detach device xml: <interface type="ethernet">
Nov 16 00:41:59 user nova-compute[75826]:   <mac address="fa:16:3e:26:dd:4c"/>
Nov 16 00:41:59 user nova-compute[75826]:   <model type="virtio"/>
Nov 16 00:41:59 user nova-compute[75826]:   <mtu size="1442"/>
Nov 16 00:41:59 user nova-compute[75826]:   <target dev="tap3ed8b208-87"/>
Nov 16 00:41:59 user nova-compute[75826]: </interface>
Nov 16 00:41:59 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Start waiting for the detach event from libvirt for device tap3ed8b208-87 with device alias net1 for instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-587027cf-89f9-434d-94d7-fbb3bcd7ec5f req-da6f2c77-31e6-4c1d-b47e-29f22f385875 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-vif-unplugged-3ed8b208-8715-4d4b-8be5-7ad437342e88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-587027cf-89f9-434d-94d7-fbb3bcd7ec5f req-da6f2c77-31e6-4c1d-b47e-29f22f385875 service nova] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-587027cf-89f9-434d-94d7-fbb3bcd7ec5f req-da6f2c77-31e6-4c1d-b47e-29f22f385875 service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-587027cf-89f9-434d-94d7-fbb3bcd7ec5f req-da6f2c77-31e6-4c1d-b47e-29f22f385875 service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-587027cf-89f9-434d-94d7-fbb3bcd7ec5f req-da6f2c77-31e6-4c1d-b47e-29f22f385875 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] No waiting events found dispatching network-vif-unplugged-3ed8b208-8715-4d4b-8be5-7ad437342e88 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:00 user nova-compute[75826]: WARNING nova.compute.manager [req-587027cf-89f9-434d-94d7-fbb3bcd7ec5f req-da6f2c77-31e6-4c1d-b47e-29f22f385875 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received unexpected event network-vif-unplugged-3ed8b208-8715-4d4b-8be5-7ad437342e88 for instance with vm_state active and task_state None.
Nov 16 00:42:00 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:42:00 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:42:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:01 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updating instance_info_cache with network_info: [{"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:42:01 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:42:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:42:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:42:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:42:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:42:01 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:42:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-1e9b033d-312c-4596-a7b0-e099399442a2 req-5a0cf735-349a-4ea0-9e46-f6ea1b8b2d76 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-vif-plugged-3ed8b208-8715-4d4b-8be5-7ad437342e88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1e9b033d-312c-4596-a7b0-e099399442a2 req-5a0cf735-349a-4ea0-9e46-f6ea1b8b2d76 service nova] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1e9b033d-312c-4596-a7b0-e099399442a2 req-5a0cf735-349a-4ea0-9e46-f6ea1b8b2d76 service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1e9b033d-312c-4596-a7b0-e099399442a2 req-5a0cf735-349a-4ea0-9e46-f6ea1b8b2d76 service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-1e9b033d-312c-4596-a7b0-e099399442a2 req-5a0cf735-349a-4ea0-9e46-f6ea1b8b2d76 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] No waiting events found dispatching network-vif-plugged-3ed8b208-8715-4d4b-8be5-7ad437342e88 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:02 user nova-compute[75826]: WARNING nova.compute.manager [req-1e9b033d-312c-4596-a7b0-e099399442a2 req-5a0cf735-349a-4ea0-9e46-f6ea1b8b2d76 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received unexpected event network-vif-plugged-3ed8b208-8715-4d4b-8be5-7ad437342e88 for instance with vm_state active and task_state None.
Nov 16 00:42:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:02 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:42:03 user nova-compute[75826]: INFO nova.compute.claims [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Claim successful on node user
Nov 16 00:42:03 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:42:03 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:42:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:42:03 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 is timed out.
Nov 16 00:42:03 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Successfully detached device vdb from instance 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 from the live domain config.
Nov 16 00:42:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfGjLnWb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:42:03 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG nova.policy [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8606321461c403cbec7f0a36e454bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c7fd936b74e109f83fc69060af216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:03 user nova-compute[75826]: INFO nova.virt.block_device [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Booting with blank volume at /dev/vda
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6139ee-ccee-495e-b891-ec586b7ba1f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:42:03 user nova-compute[75826]: No targets found.
Nov 16 00:42:03 user nova-compute[75826]: iSNS:
Nov 16 00:42:03 user nova-compute[75826]: No targets found.
Nov 16 00:42:03 user nova-compute[75826]: STATIC:
Nov 16 00:42:03 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632
Nov 16 00:42:03 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:42:03 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:42:03 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f
Nov 16 00:42:03 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:42:03 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:42:03 user nova-compute[75826]: FIRMWARE:
Nov 16 00:42:03 user nova-compute[75826]: No targets found.
Nov 16 00:42:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:42:03 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:42:03 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[554d173f-28f4-4c8a-87c3-580b600be45e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[70197f80-a376-4754-9cf0-38609c25aac3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:42:03 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:42:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f (non-flash)
Nov 16 00:42:03 user nova-compute[75826]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:42:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdc0d9a710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f'): ({'sdg'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Removing single pathed devices sdg {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.040s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea953cc-7916-405d-98ee-656d5d9de257]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[39498b12-39b2-47a0-a40e-ea83336a9f5a]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Flushing IO for device /dev/sdg {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.012s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9f66d1-7657-4733-807f-21a8d28693a4]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[700f39ec-66a1-4845-a2f8-4cf7c679ec88]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] SCSI volumes sdg have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e4541b-a159-4b03-a5ca-e8756870d47e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9303de1-d5db-4243-a134-117007d1577a]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f, portal: 172.16.0.220,3260]
Nov 16 00:42:04 user nova-compute[75826]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f, portal: 172.16.0.220,3260] successful.
Nov 16 00:42:04 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83ab1a32-be63-4012-b80e-d0945bce3f7f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[304554fc-6c1a-4ec7-85aa-1661c035522e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:42:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] <== disconnect_volume: return (317ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:42:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:42:04 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Successfully created port: 9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG nova.objects.instance [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lazy-loading 'flavor' on Instance uuid 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-25cbb505-18b9-447b-be3e-10d77cd10863 tempest-VolumesAssistedSnapshotsTest-1447724978 tempest-VolumesAssistedSnapshotsTest-1447724978-project-admin] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.860s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Successfully updated port: 9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquired lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-3d622c1e-684e-4f4a-8f8f-65e1a5c7d99b req-b820de04-9754-4edc-91ce-de3a84313713 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-changed-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-3d622c1e-684e-4f4a-8f8f-65e1a5c7d99b req-b820de04-9754-4edc-91ce-de3a84313713 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Refreshing instance network info cache due to event network-changed-9a741ee6-00d4-49d0-8562-3ece777615c8. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3d622c1e-684e-4f4a-8f8f-65e1a5c7d99b req-b820de04-9754-4edc-91ce-de3a84313713 service nova] Acquiring lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Updating instance_info_cache with network_info: [{"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Releasing lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Instance network_info: |[{"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3d622c1e-684e-4f4a-8f8f-65e1a5c7d99b req-b820de04-9754-4edc-91ce-de3a84313713 service nova] Acquired lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG nova.network.neutron [req-3d622c1e-684e-4f4a-8f8f-65e1a5c7d99b req-b820de04-9754-4edc-91ce-de3a84313713 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Refreshing network info cache for port 9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG nova.network.neutron [req-3d622c1e-684e-4f4a-8f8f-65e1a5c7d99b req-b820de04-9754-4edc-91ce-de3a84313713 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Updated VIF entry in instance network info cache for port 9a741ee6-00d4-49d0-8562-3ece777615c8. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG nova.network.neutron [req-3d622c1e-684e-4f4a-8f8f-65e1a5c7d99b req-b820de04-9754-4edc-91ce-de3a84313713 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Updating instance_info_cache with network_info: [{"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3d622c1e-684e-4f4a-8f8f-65e1a5c7d99b req-b820de04-9754-4edc-91ce-de3a84313713 service nova] Releasing lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:42:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG os_brick.utils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63dbdef-279c-4a5c-8d54-2e58ec6468e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e29ee054-a44b-4fe4-a714-c9ee647f342d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6309db-7d4f-4263-8388-c33e3913956c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcce4ef-df00-48b2-9654-c4f54a3a7a56]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:42:09 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:42:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c3fa2a-083f-47a8-9014-bc8a263e3737]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG os_brick.utils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:42:09 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Updating existing volume attachment record: 192aaa26-8e1c-4b8e-bae3-c3990f0b8f76 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:42:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:10 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:42:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:10 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:42:10 user nova-compute[75826]: INFO nova.compute.claims [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Claim successful on node user
Nov 16 00:42:10 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:42:10 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:42:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.388s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:10 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:42:11 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:42:11 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG nova.policy [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a858d73834524c86a1c5c8514270761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c770637392a544c48a72c953bfd9e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:42:11 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Creating image(s)
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "/opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "/opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.189s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Successfully created port: 29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk 1073741824" returned: 0 in 0.072s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:42:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Cannot resize image /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Ensure instance console log exists: /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Successfully updated port: 29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquired lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-be1884b5-2018-49b0-ac72-2ecb273e063d req-83926973-4c12-4968-a2d9-2307a284678f service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-changed-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-be1884b5-2018-49b0-ac72-2ecb273e063d req-83926973-4c12-4968-a2d9-2307a284678f service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Refreshing instance network info cache due to event network-changed-29ee5e10-3912-41da-a701-c5034a67f421. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-be1884b5-2018-49b0-ac72-2ecb273e063d req-83926973-4c12-4968-a2d9-2307a284678f service nova] Acquiring lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updating instance_info_cache with network_info: [{"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Releasing lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Instance network_info: |[{"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-be1884b5-2018-49b0-ac72-2ecb273e063d req-83926973-4c12-4968-a2d9-2307a284678f service nova] Acquired lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.network.neutron [req-be1884b5-2018-49b0-ac72-2ecb273e063d req-83926973-4c12-4968-a2d9-2307a284678f service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Refreshing network info cache for port 29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Start _get_guest_xml network_info=[{"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:42:12 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:42:12 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1545772247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1545772247',id=14,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5B66Qf+MQGsHfinCxf1C+yam25N2g58fRRofO5wiRA1j5R2phnunwEELoIaU0Cin2x5UxLqXlSqPNgeM2aMFAQihMiJ2zI238LG+ZeDaRhOUk0Ki09+Ilf/kkDnLo82w==',key_name='tempest-keypair-48608115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c770637392a544c48a72c953bfd9e7c6',ramdisk_id='',reservation_id='r-r9359cng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849437325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849437325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:42:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a858d73834524c86a1c5c8514270761e',uuid=5fdf32cf-b23f-4b65-8a47-1cf913b950d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converting VIF {"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:42:12 user nova-compute[75826]:   <uuid>5fdf32cf-b23f-4b65-8a47-1cf913b950d9</uuid>
Nov 16 00:42:12 user nova-compute[75826]:   <name>instance-0000000e</name>
Nov 16 00:42:12 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:42:12 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:42:12 user nova-compute[75826]:   <metadata>
Nov 16 00:42:12 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:42:12 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:42:12 user nova-compute[75826]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1545772247</nova:name>
Nov 16 00:42:12 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:42:12</nova:creationTime>
Nov 16 00:42:12 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:42:12 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:42:12 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:42:12 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:42:12 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:42:12 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:42:12 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:42:12 user nova-compute[75826]:       <nova:owner>
Nov 16 00:42:12 user nova-compute[75826]:         <nova:user uuid="a858d73834524c86a1c5c8514270761e">tempest-AttachVolumeShelveTestJSON-1849437325-project-member</nova:user>
Nov 16 00:42:12 user nova-compute[75826]:         <nova:project uuid="c770637392a544c48a72c953bfd9e7c6">tempest-AttachVolumeShelveTestJSON-1849437325</nova:project>
Nov 16 00:42:12 user nova-compute[75826]:       </nova:owner>
Nov 16 00:42:12 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:42:12 user nova-compute[75826]:       <nova:ports>
Nov 16 00:42:12 user nova-compute[75826]:         <nova:port uuid="29ee5e10-3912-41da-a701-c5034a67f421">
Nov 16 00:42:12 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 00:42:12 user nova-compute[75826]:         </nova:port>
Nov 16 00:42:12 user nova-compute[75826]:       </nova:ports>
Nov 16 00:42:12 user nova-compute[75826]:     </nova:instance>
Nov 16 00:42:12 user nova-compute[75826]:   </metadata>
Nov 16 00:42:12 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:42:12 user nova-compute[75826]:     <system>
Nov 16 00:42:12 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:42:12 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:42:12 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:42:12 user nova-compute[75826]:       <entry name="serial">5fdf32cf-b23f-4b65-8a47-1cf913b950d9</entry>
Nov 16 00:42:12 user nova-compute[75826]:       <entry name="uuid">5fdf32cf-b23f-4b65-8a47-1cf913b950d9</entry>
Nov 16 00:42:12 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:42:12 user nova-compute[75826]:     </system>
Nov 16 00:42:12 user nova-compute[75826]:   </sysinfo>
Nov 16 00:42:12 user nova-compute[75826]:   <os>
Nov 16 00:42:12 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:42:12 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:42:12 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:42:12 user nova-compute[75826]:   </os>
Nov 16 00:42:12 user nova-compute[75826]:   <features>
Nov 16 00:42:12 user nova-compute[75826]:     <acpi/>
Nov 16 00:42:12 user nova-compute[75826]:     <apic/>
Nov 16 00:42:12 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:42:12 user nova-compute[75826]:   </features>
Nov 16 00:42:12 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:42:12 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:42:12 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:42:12 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:42:12 user nova-compute[75826]:   </clock>
Nov 16 00:42:12 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:42:12 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:42:12 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:42:12 user nova-compute[75826]:   </cpu>
Nov 16 00:42:12 user nova-compute[75826]:   <devices>
Nov 16 00:42:12 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:42:12 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:42:12 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk"/>
Nov 16 00:42:12 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:42:12 user nova-compute[75826]:     </disk>
Nov 16 00:42:12 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:42:12 user nova-compute[75826]:       <mac address="fa:16:3e:44:bf:4c"/>
Nov 16 00:42:12 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:42:12 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:42:12 user nova-compute[75826]:       <target dev="tap29ee5e10-39"/>
Nov 16 00:42:12 user nova-compute[75826]:     </interface>
Nov 16 00:42:12 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:42:12 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/console.log" append="off"/>
Nov 16 00:42:12 user nova-compute[75826]:     </serial>
Nov 16 00:42:12 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:42:12 user nova-compute[75826]:     <video>
Nov 16 00:42:12 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:42:12 user nova-compute[75826]:     </video>
Nov 16 00:42:12 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:42:12 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:42:12 user nova-compute[75826]:     </rng>
Nov 16 00:42:12 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:42:12 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:42:12 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:42:12 user nova-compute[75826]:     </memballoon>
Nov 16 00:42:12 user nova-compute[75826]:   </devices>
Nov 16 00:42:12 user nova-compute[75826]: </domain>
Nov 16 00:42:12 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1545772247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1545772247',id=14,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5B66Qf+MQGsHfinCxf1C+yam25N2g58fRRofO5wiRA1j5R2phnunwEELoIaU0Cin2x5UxLqXlSqPNgeM2aMFAQihMiJ2zI238LG+ZeDaRhOUk0Ki09+Ilf/kkDnLo82w==',key_name='tempest-keypair-48608115',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c770637392a544c48a72c953bfd9e7c6',ramdisk_id='',reservation_id='r-r9359cng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849437325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849437325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:42:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a858d73834524c86a1c5c8514270761e',uuid=5fdf32cf-b23f-4b65-8a47-1cf913b950d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converting VIF {"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG os_vif [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38c06e10-1a65-5ee0-9f1d-3d52e1d809ff', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29ee5e10-39, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29ee5e10-39, col_values=(('qos', UUID('0cbbeeef-0b7f-4b80-ad89-f432391b1381')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29ee5e10-39, col_values=(('external_ids', {'iface-id': '29ee5e10-3912-41da-a701-c5034a67f421', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:bf:4c', 'vm-uuid': '5fdf32cf-b23f-4b65-8a47-1cf913b950d9'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:12 user nova-compute[75826]: INFO os_vif [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39')
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:42:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] No VIF found with MAC fa:16:3e:44:bf:4c, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:42:13 user nova-compute[75826]: DEBUG nova.network.neutron [req-be1884b5-2018-49b0-ac72-2ecb273e063d req-83926973-4c12-4968-a2d9-2307a284678f service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updated VIF entry in instance network info cache for port 29ee5e10-3912-41da-a701-c5034a67f421. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:42:13 user nova-compute[75826]: DEBUG nova.network.neutron [req-be1884b5-2018-49b0-ac72-2ecb273e063d req-83926973-4c12-4968-a2d9-2307a284678f service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updating instance_info_cache with network_info: [{"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-be1884b5-2018-49b0-ac72-2ecb273e063d req-83926973-4c12-4968-a2d9-2307a284678f service nova] Releasing lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:42:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:42:14 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Creating image(s)
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Ensure instance console log exists: /opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Start _get_guest_xml network_info=[{"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '192aaa26-8e1c-4b8e-bae3-c3990f0b8f76', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZOvXJio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7e39321-f2f6-44b8-88ce-6ea0337e7857', 'serial': 'b7e39321-f2f6-44b8-88ce-6ea0337e7857'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:42:14 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:42:14 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZOvXJio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:42:14 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:42:14 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:42:14 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-d350a3dd-8039-4fce-a8e3-b41a7e7cbc97 req-6180bf25-5bc5-41bd-8a52-cf1cabd919e7 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d350a3dd-8039-4fce-a8e3-b41a7e7cbc97 req-6180bf25-5bc5-41bd-8a52-cf1cabd919e7 service nova] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d350a3dd-8039-4fce-a8e3-b41a7e7cbc97 req-6180bf25-5bc5-41bd-8a52-cf1cabd919e7 service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d350a3dd-8039-4fce-a8e3-b41a7e7cbc97 req-6180bf25-5bc5-41bd-8a52-cf1cabd919e7 service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-d350a3dd-8039-4fce-a8e3-b41a7e7cbc97 req-6180bf25-5bc5-41bd-8a52-cf1cabd919e7 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] No waiting events found dispatching network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:14 user nova-compute[75826]: WARNING nova.compute.manager [req-d350a3dd-8039-4fce-a8e3-b41a7e7cbc97 req-6180bf25-5bc5-41bd-8a52-cf1cabd919e7 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received unexpected event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 for instance with vm_state building and task_state spawning.
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[49183099-0103-4b1a-86a8-4fbb13713ded]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:42:14 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc80979-9f24-4b8e-8f24-813c30e039fd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857] added
Nov 16 00:42:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1852bf5-6b0d-40c4-a08b-46c7968a23b0]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1e36ac-5a18-49f8-bace-eb82b4ad2105]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZOvXJio {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZOvXJio" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabe0b0b-6e43-45e3-8447-6b913f197e4f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GZOvXJio'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f5bdab-826e-4863-ab43-3a608fa532d7]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a537f177-218b-4856-b384-84b299b93277]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:42:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:42:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83cc549-e597-4b85-970d-f7bffcd80cf9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857, portal: 172.16.0.220,3260]
Nov 16 00:42:14 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857, portal: 172.16.0.220,3260] successful.
Nov 16 00:42:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[846bf51c-bc5e-4985-b4ad-7fd66c04a2b9]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d80ada-2276-445d-a168-0f308feb0f66]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:42:14 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:42:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:42:14 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:42:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f701ca5-a922-44c7-aae4-36272191a198]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZOvXJio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:42:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23939633531326431', 'path': '/dev/sdb'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939633531326431', 'path': '/dev/sdb'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1180544394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1180544394',id=13,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-wr2i12dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:42:04Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:64:fa,bridge_name='br-int',has_traffic_filtering=True,id=9a741ee6-00d4-49d0-8562-3ece777615c8,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a741ee6-00') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG nova.objects.instance [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:42:15 user nova-compute[75826]:   <uuid>2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c</uuid>
Nov 16 00:42:15 user nova-compute[75826]:   <name>instance-0000000d</name>
Nov 16 00:42:15 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:42:15 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:42:15 user nova-compute[75826]:   <metadata>
Nov 16 00:42:15 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:42:15 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:42:15 user nova-compute[75826]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1180544394</nova:name>
Nov 16 00:42:15 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:42:14</nova:creationTime>
Nov 16 00:42:15 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:42:15 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:42:15 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:42:15 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:42:15 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:42:15 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:42:15 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:42:15 user nova-compute[75826]:       <nova:owner>
Nov 16 00:42:15 user nova-compute[75826]:         <nova:user uuid="f8606321461c403cbec7f0a36e454bc8">tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member</nova:user>
Nov 16 00:42:15 user nova-compute[75826]:         <nova:project uuid="e45c7fd936b74e109f83fc69060af216">tempest-ServerBootFromVolumeStableRescueTest-1116494461</nova:project>
Nov 16 00:42:15 user nova-compute[75826]:       </nova:owner>
Nov 16 00:42:15 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:42:15 user nova-compute[75826]:       <nova:ports>
Nov 16 00:42:15 user nova-compute[75826]:         <nova:port uuid="9a741ee6-00d4-49d0-8562-3ece777615c8">
Nov 16 00:42:15 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 00:42:15 user nova-compute[75826]:         </nova:port>
Nov 16 00:42:15 user nova-compute[75826]:       </nova:ports>
Nov 16 00:42:15 user nova-compute[75826]:     </nova:instance>
Nov 16 00:42:15 user nova-compute[75826]:   </metadata>
Nov 16 00:42:15 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:42:15 user nova-compute[75826]:     <system>
Nov 16 00:42:15 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:42:15 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:42:15 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:42:15 user nova-compute[75826]:       <entry name="serial">2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c</entry>
Nov 16 00:42:15 user nova-compute[75826]:       <entry name="uuid">2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c</entry>
Nov 16 00:42:15 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:42:15 user nova-compute[75826]:     </system>
Nov 16 00:42:15 user nova-compute[75826]:   </sysinfo>
Nov 16 00:42:15 user nova-compute[75826]:   <os>
Nov 16 00:42:15 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:42:15 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:42:15 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:42:15 user nova-compute[75826]:   </os>
Nov 16 00:42:15 user nova-compute[75826]:   <features>
Nov 16 00:42:15 user nova-compute[75826]:     <acpi/>
Nov 16 00:42:15 user nova-compute[75826]:     <apic/>
Nov 16 00:42:15 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:42:15 user nova-compute[75826]:   </features>
Nov 16 00:42:15 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:42:15 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:42:15 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:42:15 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:42:15 user nova-compute[75826]:   </clock>
Nov 16 00:42:15 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:42:15 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:42:15 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:42:15 user nova-compute[75826]:   </cpu>
Nov 16 00:42:15 user nova-compute[75826]:   <devices>
Nov 16 00:42:15 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:42:15 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:42:15 user nova-compute[75826]:       <source dev="/dev/sdb"/>
Nov 16 00:42:15 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:42:15 user nova-compute[75826]:       <serial>b7e39321-f2f6-44b8-88ce-6ea0337e7857</serial>
Nov 16 00:42:15 user nova-compute[75826]:     </disk>
Nov 16 00:42:15 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:42:15 user nova-compute[75826]:       <mac address="fa:16:3e:f5:64:fa"/>
Nov 16 00:42:15 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:42:15 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:42:15 user nova-compute[75826]:       <target dev="tap9a741ee6-00"/>
Nov 16 00:42:15 user nova-compute[75826]:     </interface>
Nov 16 00:42:15 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:42:15 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/console.log" append="off"/>
Nov 16 00:42:15 user nova-compute[75826]:     </serial>
Nov 16 00:42:15 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:42:15 user nova-compute[75826]:     <video>
Nov 16 00:42:15 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:42:15 user nova-compute[75826]:     </video>
Nov 16 00:42:15 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:42:15 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:42:15 user nova-compute[75826]:     </rng>
Nov 16 00:42:15 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:42:15 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:42:15 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:42:15 user nova-compute[75826]:     </memballoon>
Nov 16 00:42:15 user nova-compute[75826]:   </devices>
Nov 16 00:42:15 user nova-compute[75826]: </domain>
Nov 16 00:42:15 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1180544394',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1180544394',id=13,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-wr2i12dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:42:04Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:64:fa,bridge_name='br-int',has_traffic_filtering=True,id=9a741ee6-00d4-49d0-8562-3ece777615c8,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a741ee6-00') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG os_vif [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:64:fa,bridge_name='br-int',has_traffic_filtering=True,id=9a741ee6-00d4-49d0-8562-3ece777615c8,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a741ee6-00') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '757ea604-de41-5047-9567-5e43aa8e6365', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9a741ee6-00, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9a741ee6-00, col_values=(('qos', UUID('15cce8e4-eaf7-4743-9c19-fad2c1114108')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9a741ee6-00, col_values=(('external_ids', {'iface-id': '9a741ee6-00d4-49d0-8562-3ece777615c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:64:fa', 'vm-uuid': '2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:16 user nova-compute[75826]: INFO os_vif [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:64:fa,bridge_name='br-int',has_traffic_filtering=True,id=9a741ee6-00d4-49d0-8562-3ece777615c8,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a741ee6-00')
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No VIF found with MAC fa:16:3e:f5:64:fa, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:42:16 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Instance spawned successfully.
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:16 user nova-compute[75826]: INFO nova.compute.manager [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.compute.manager [req-1b09641e-ff87-4650-ba67-c1ea8f4c9704 req-8e6524d7-0da9-4f28-a7ae-0259c29021da service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1b09641e-ff87-4650-ba67-c1ea8f4c9704 req-8e6524d7-0da9-4f28-a7ae-0259c29021da service nova] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1b09641e-ff87-4650-ba67-c1ea8f4c9704 req-8e6524d7-0da9-4f28-a7ae-0259c29021da service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1b09641e-ff87-4650-ba67-c1ea8f4c9704 req-8e6524d7-0da9-4f28-a7ae-0259c29021da service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:16 user nova-compute[75826]: DEBUG nova.compute.manager [req-1b09641e-ff87-4650-ba67-c1ea8f4c9704 req-8e6524d7-0da9-4f28-a7ae-0259c29021da service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] No waiting events found dispatching network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:16 user nova-compute[75826]: WARNING nova.compute.manager [req-1b09641e-ff87-4650-ba67-c1ea8f4c9704 req-8e6524d7-0da9-4f28-a7ae-0259c29021da service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received unexpected event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 for instance with vm_state building and task_state spawning.
Nov 16 00:42:16 user nova-compute[75826]: INFO nova.compute.manager [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Took 6.22 seconds to build instance.
Nov 16 00:42:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4c321a4c-a069-497d-932c-e2cc6203746f tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.364s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-ba754852-84c7-4735-9037-0d3d23f10025 req-884c111a-d037-43d5-85a1-2c151bbf7046 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ba754852-84c7-4735-9037-0d3d23f10025 req-884c111a-d037-43d5-85a1-2c151bbf7046 service nova] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ba754852-84c7-4735-9037-0d3d23f10025 req-884c111a-d037-43d5-85a1-2c151bbf7046 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ba754852-84c7-4735-9037-0d3d23f10025 req-884c111a-d037-43d5-85a1-2c151bbf7046 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-ba754852-84c7-4735-9037-0d3d23f10025 req-884c111a-d037-43d5-85a1-2c151bbf7046 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] No waiting events found dispatching network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:17 user nova-compute[75826]: WARNING nova.compute.manager [req-ba754852-84c7-4735-9037-0d3d23f10025 req-884c111a-d037-43d5-85a1-2c151bbf7046 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received unexpected event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 for instance with vm_state building and task_state spawning.
Nov 16 00:42:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "298aaae2-dd4e-412a-8afb-dfaafbd36964" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:18 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:42:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:42:18 user nova-compute[75826]: INFO nova.compute.claims [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Claim successful on node user
Nov 16 00:42:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:18 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:42:18 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.542s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:42:19 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.policy [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a021a407de284df491fe3dc7b0608403', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f6aa796a8fb4ea79988055543768456', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:42:19 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Creating image(s)
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "/opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "/opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "/opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.199s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.203s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk 1073741824" returned: 0 in 0.050s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:42:19 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Instance spawned successfully.
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.compute.manager [req-4179b833-b394-4d8c-965d-9fcf52dda555 req-026bb359-95dc-4160-9d93-103ed6301509 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4179b833-b394-4d8c-965d-9fcf52dda555 req-026bb359-95dc-4160-9d93-103ed6301509 service nova] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4179b833-b394-4d8c-965d-9fcf52dda555 req-026bb359-95dc-4160-9d93-103ed6301509 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4179b833-b394-4d8c-965d-9fcf52dda555 req-026bb359-95dc-4160-9d93-103ed6301509 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.compute.manager [req-4179b833-b394-4d8c-965d-9fcf52dda555 req-026bb359-95dc-4160-9d93-103ed6301509 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] No waiting events found dispatching network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:19 user nova-compute[75826]: WARNING nova.compute.manager [req-4179b833-b394-4d8c-965d-9fcf52dda555 req-026bb359-95dc-4160-9d93-103ed6301509 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received unexpected event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 for instance with vm_state building and task_state spawning.
Nov 16 00:42:19 user nova-compute[75826]: INFO nova.compute.manager [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Took 5.39 seconds to spawn the instance on the hypervisor.
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.226s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Checking if we can resize image /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:42:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:19 user nova-compute[75826]: INFO nova.compute.manager [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Took 16.82 seconds to build instance.
Nov 16 00:42:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c9aff38-381c-46f0-b574-f8d3c95ca4fb tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.102s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Cannot resize image /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Ensure instance console log exists: /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Successfully created port: e111e80e-fa44-4274-9130-728acbf11cce {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:42:20 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Waiting for libvirt event about the detach of device tap3ed8b208-87 with device alias net1 from instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 is timed out.
Nov 16 00:42:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:26:dd:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap3ed8b208-87"/></interface> {{(pid=75826) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:26:dd:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap3ed8b208-87"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 16 00:42:20 user nova-compute[75826]:   <name>instance-00000009</name>
Nov 16 00:42:20 user nova-compute[75826]:   <uuid>203da1ce-e5b1-4a16-a75e-e934c68d6e68</uuid>
Nov 16 00:42:20 user nova-compute[75826]:   <metadata>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:42:20 user nova-compute[75826]:   <nova:package version="0.0.0"/>
Nov 16 00:42:20 user nova-compute[75826]:   <nova:name>tempest-device-tagging-server-73313562</nova:name>
Nov 16 00:42:20 user nova-compute[75826]:   <nova:creationTime>2023-11-16 00:41:28</nova:creationTime>
Nov 16 00:42:20 user nova-compute[75826]:   <nova:flavor name="m1.tiny">
Nov 16 00:42:20 user nova-compute[75826]:     <nova:memory>512</nova:memory>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:disk>1</nova:disk>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:swap>0</nova:swap>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:vcpus>1</nova:vcpus>
Nov 16 00:42:20 user nova-compute[75826]:   </nova:flavor>
Nov 16 00:42:20 user nova-compute[75826]:   <nova:owner>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:user uuid="159de45699cb47c68211051c7f62dae4">tempest-TaggedAttachmentsTest-2144441547-project-member</nova:user>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:project uuid="6e313a75f9fc4e91b5866d0228336b0b">tempest-TaggedAttachmentsTest-2144441547</nova:project>
Nov 16 00:42:20 user nova-compute[75826]:   </nova:owner>
Nov 16 00:42:20 user nova-compute[75826]:   <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:42:20 user nova-compute[75826]:   <nova:ports>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:port uuid="ebabaf39-8f6c-4790-b555-271d5aef9db8">
Nov 16 00:42:20 user nova-compute[75826]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:42:20 user nova-compute[75826]:     </nova:port>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:port uuid="3ed8b208-8715-4d4b-8be5-7ad437342e88">
Nov 16 00:42:20 user nova-compute[75826]:       <nova:ip type="fixed" address="10.10.10.194" ipVersion="4"/>
Nov 16 00:42:20 user nova-compute[75826]:     </nova:port>
Nov 16 00:42:20 user nova-compute[75826]:   </nova:ports>
Nov 16 00:42:20 user nova-compute[75826]: </nova:instance>
Nov 16 00:42:20 user nova-compute[75826]:   </metadata>
Nov 16 00:42:20 user nova-compute[75826]:   <memory unit='KiB'>524288</memory>
Nov 16 00:42:20 user nova-compute[75826]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 00:42:20 user nova-compute[75826]:   <vcpu placement='static'>1</vcpu>
Nov 16 00:42:20 user nova-compute[75826]:   <resource>
Nov 16 00:42:20 user nova-compute[75826]:     <partition>/machine</partition>
Nov 16 00:42:20 user nova-compute[75826]:   </resource>
Nov 16 00:42:20 user nova-compute[75826]:   <sysinfo type='smbios'>
Nov 16 00:42:20 user nova-compute[75826]:     <system>
Nov 16 00:42:20 user nova-compute[75826]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 00:42:20 user nova-compute[75826]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 00:42:20 user nova-compute[75826]:       <entry name='version'>0.0.0</entry>
Nov 16 00:42:20 user nova-compute[75826]:       <entry name='serial'>203da1ce-e5b1-4a16-a75e-e934c68d6e68</entry>
Nov 16 00:42:20 user nova-compute[75826]:       <entry name='uuid'>203da1ce-e5b1-4a16-a75e-e934c68d6e68</entry>
Nov 16 00:42:20 user nova-compute[75826]:       <entry name='family'>Virtual Machine</entry>
Nov 16 00:42:20 user nova-compute[75826]:     </system>
Nov 16 00:42:20 user nova-compute[75826]:   </sysinfo>
Nov 16 00:42:20 user nova-compute[75826]:   <os>
Nov 16 00:42:20 user nova-compute[75826]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 00:42:20 user nova-compute[75826]:     <boot dev='hd'/>
Nov 16 00:42:20 user nova-compute[75826]:     <smbios mode='sysinfo'/>
Nov 16 00:42:20 user nova-compute[75826]:   </os>
Nov 16 00:42:20 user nova-compute[75826]:   <features>
Nov 16 00:42:20 user nova-compute[75826]:     <acpi/>
Nov 16 00:42:20 user nova-compute[75826]:     <apic/>
Nov 16 00:42:20 user nova-compute[75826]:     <vmcoreinfo state='on'/>
Nov 16 00:42:20 user nova-compute[75826]:   </features>
Nov 16 00:42:20 user nova-compute[75826]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 00:42:20 user nova-compute[75826]:     <model fallback='forbid'>Nehalem</model>
Nov 16 00:42:20 user nova-compute[75826]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 00:42:20 user nova-compute[75826]:     <feature policy='require' name='vme'/>
Nov 16 00:42:20 user nova-compute[75826]:     <feature policy='require' name='x2apic'/>
Nov 16 00:42:20 user nova-compute[75826]:     <feature policy='require' name='hypervisor'/>
Nov 16 00:42:20 user nova-compute[75826]:   </cpu>
Nov 16 00:42:20 user nova-compute[75826]:   <clock offset='utc'>
Nov 16 00:42:20 user nova-compute[75826]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 00:42:20 user nova-compute[75826]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 00:42:20 user nova-compute[75826]:     <timer name='hpet' present='no'/>
Nov 16 00:42:20 user nova-compute[75826]:   </clock>
Nov 16 00:42:20 user nova-compute[75826]:   <on_poweroff>destroy</on_poweroff>
Nov 16 00:42:20 user nova-compute[75826]:   <on_reboot>restart</on_reboot>
Nov 16 00:42:20 user nova-compute[75826]:   <on_crash>destroy</on_crash>
Nov 16 00:42:20 user nova-compute[75826]:   <devices>
Nov 16 00:42:20 user nova-compute[75826]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 00:42:20 user nova-compute[75826]:     <disk type='file' device='disk'>
Nov 16 00:42:20 user nova-compute[75826]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 00:42:20 user nova-compute[75826]:       <source file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk' index='2'/>
Nov 16 00:42:20 user nova-compute[75826]:       <backingStore type='file' index='3'>
Nov 16 00:42:20 user nova-compute[75826]:         <format type='raw'/>
Nov 16 00:42:20 user nova-compute[75826]:         <source file='/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e'/>
Nov 16 00:42:20 user nova-compute[75826]:         <backingStore/>
Nov 16 00:42:20 user nova-compute[75826]:       </backingStore>
Nov 16 00:42:20 user nova-compute[75826]:       <target dev='vda' bus='virtio'/>
Nov 16 00:42:20 user nova-compute[75826]:       <alias name='virtio-disk0'/>
Nov 16 00:42:20 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 00:42:20 user nova-compute[75826]:     </disk>
Nov 16 00:42:20 user nova-compute[75826]:     <disk type='file' device='cdrom'>
Nov 16 00:42:20 user nova-compute[75826]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 00:42:20 user nova-compute[75826]:       <source file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk.config' index='1'/>
Nov 16 00:42:20 user nova-compute[75826]:       <backingStore/>
Nov 16 00:42:20 user nova-compute[75826]:       <target dev='hda' bus='ide'/>
Nov 16 00:42:20 user nova-compute[75826]:       <readonly/>
Nov 16 00:42:20 user nova-compute[75826]:       <alias name='ide0-0-0'/>
Nov 16 00:42:20 user nova-compute[75826]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 00:42:20 user nova-compute[75826]:     </disk>
Nov 16 00:42:20 user nova-compute[75826]:     <controller type='usb' index='0' model='none'>
Nov 16 00:42:20 user nova-compute[75826]:       <alias name='usb'/>
Nov 16 00:42:20 user nova-compute[75826]:     </controller>
Nov 16 00:42:20 user nova-compute[75826]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 00:42:20 user nova-compute[75826]:       <alias name='pci.0'/>
Nov 16 00:42:20 user nova-compute[75826]:     </controller>
Nov 16 00:42:20 user nova-compute[75826]:     <controller type='ide' index='0'>
Nov 16 00:42:20 user nova-compute[75826]:       <alias name='ide'/>
Nov 16 00:42:20 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 00:42:20 user nova-compute[75826]:     </controller>
Nov 16 00:42:20 user nova-compute[75826]:     <interface type='ethernet'>
Nov 16 00:42:20 user nova-compute[75826]:       <mac address='fa:16:3e:d3:17:39'/>
Nov 16 00:42:20 user nova-compute[75826]:       <target dev='tapebabaf39-8f'/>
Nov 16 00:42:20 user nova-compute[75826]:       <model type='virtio'/>
Nov 16 00:42:20 user nova-compute[75826]:       <mtu size='1442'/>
Nov 16 00:42:20 user nova-compute[75826]:       <alias name='net0'/>
Nov 16 00:42:20 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 00:42:20 user nova-compute[75826]:     </interface>
Nov 16 00:42:20 user nova-compute[75826]:     <serial type='pty'>
Nov 16 00:42:20 user nova-compute[75826]:       <source path='/dev/pts/7'/>
Nov 16 00:42:20 user nova-compute[75826]:       <log file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/console.log' append='off'/>
Nov 16 00:42:20 user nova-compute[75826]:       <target type='isa-serial' port='0'>
Nov 16 00:42:20 user nova-compute[75826]:         <model name='isa-serial'/>
Nov 16 00:42:20 user nova-compute[75826]:       </target>
Nov 16 00:42:20 user nova-compute[75826]:       <alias name='serial0'/>
Nov 16 00:42:20 user nova-compute[75826]:     </serial>
Nov 16 00:42:20 user nova-compute[75826]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 00:42:20 user nova-compute[75826]:       <source path='/dev/pts/7'/>
Nov 16 00:42:20 user nova-compute[75826]:       <log file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/console.log' append='off'/>
Nov 16 00:42:20 user nova-compute[75826]:       <target type='serial' port='0'/>
Nov 16 00:42:20 user nova-compute[75826]:       <alias name='serial0'/>
Nov 16 00:42:20 user nova-compute[75826]:     </console>
Nov 16 00:42:20 user nova-compute[75826]:     <input type='mouse' bus='ps2'>
Nov 16 00:42:20 user nova-compute[75826]:       <alias name='input0'/>
Nov 16 00:42:20 user nova-compute[75826]:     </input>
Nov 16 00:42:20 user nova-compute[75826]:     <input type='keyboard' bus='ps2'>
Nov 16 00:42:20 user nova-compute[75826]:       <alias name='input1'/>
Nov 16 00:42:20 user nova-compute[75826]:     </input>
Nov 16 00:42:20 user nova-compute[75826]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 16 00:42:20 user nova-compute[75826]:       <listen type='address' address='0.0.0.0'/>
Nov 16 00:42:20 user nova-compute[75826]:     </graphics>
Nov 16 00:42:20 user nova-compute[75826]:     <audio id='1' type='none'/>
Nov 16 00:42:20 user nova-compute[75826]:     <video>
Nov 16 00:42:20 user nova-compute[75826]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 00:42:20 user nova-compute[75826]:       <alias name='video0'/>
Nov 16 00:42:20 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 00:42:20 user nova-compute[75826]:     </video>
Nov 16 00:42:20 user nova-compute[75826]:     <memballoon model='virtio'>
Nov 16 00:42:20 user nova-compute[75826]:       <stats period='10'/>
Nov 16 00:42:20 user nova-compute[75826]:       <alias name='balloon0'/>
Nov 16 00:42:20 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 00:42:20 user nova-compute[75826]:     </memballoon>
Nov 16 00:42:20 user nova-compute[75826]:     <rng model='virtio'>
Nov 16 00:42:20 user nova-compute[75826]:       <backend model='random'>/dev/urandom</backend>
Nov 16 00:42:20 user nova-compute[75826]:       <alias name='rng0'/>
Nov 16 00:42:20 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 00:42:20 user nova-compute[75826]:     </rng>
Nov 16 00:42:20 user nova-compute[75826]:   </devices>
Nov 16 00:42:20 user nova-compute[75826]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 00:42:20 user nova-compute[75826]:     <label>libvirt-203da1ce-e5b1-4a16-a75e-e934c68d6e68</label>
Nov 16 00:42:20 user nova-compute[75826]:     <imagelabel>libvirt-203da1ce-e5b1-4a16-a75e-e934c68d6e68</imagelabel>
Nov 16 00:42:20 user nova-compute[75826]:   </seclabel>
Nov 16 00:42:20 user nova-compute[75826]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 00:42:20 user nova-compute[75826]:     <label>+64055:+108</label>
Nov 16 00:42:20 user nova-compute[75826]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 00:42:20 user nova-compute[75826]:   </seclabel>
Nov 16 00:42:20 user nova-compute[75826]: </domain>
Nov 16 00:42:20 user nova-compute[75826]:  {{(pid=75826) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 00:42:20 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Successfully detached device tap3ed8b208-87 from instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68 from the live domain config.
Nov 16 00:42:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73313562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73313562',id=9,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcxgQNIwtABwmWWY66lpLW4FahMujB4sq8+awLbY3j4T0F+WRfv6pOgZdlOEfsFFgqQNg0M3KAfXMF/9LBbJOCDmKtj5c59DNwM9T0+YoH3Fun1L1tu/xueB5ab2B1nPg==',key_name='tempest-keypair-1839588636',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e313a75f9fc4e91b5866d0228336b0b',ramdisk_id='',reservation_id='r-1vf0ms0c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2144441547',owner_user_name='tempest-TaggedAttachmentsTest-2144441547-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:39:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='159de45699cb47c68211051c7f62dae4',uuid=203da1ce-e5b1-4a16-a75e-e934c68d6e68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converting VIF {"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed8b208-8715-4d4b-8be5-7ad437342e88,network=Network(bc4cb393-8a3e-4322-8f51-fc958631055d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed8b208-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG os_vif [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed8b208-8715-4d4b-8be5-7ad437342e88,network=Network(bc4cb393-8a3e-4322-8f51-fc958631055d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed8b208-87') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ed8b208-87, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5331d862-ab41-4c24-aef1-3b41d96cbf02) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:20 user nova-compute[75826]: INFO os_vif [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed8b208-8715-4d4b-8be5-7ad437342e88,network=Network(bc4cb393-8a3e-4322-8f51-fc958631055d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed8b208-87')
Nov 16 00:42:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:42:20 user nova-compute[75826]:   <nova:package version="0.0.0"/>
Nov 16 00:42:20 user nova-compute[75826]:   <nova:name>tempest-device-tagging-server-73313562</nova:name>
Nov 16 00:42:20 user nova-compute[75826]:   <nova:creationTime>2023-11-16 00:42:20</nova:creationTime>
Nov 16 00:42:20 user nova-compute[75826]:   <nova:flavor name="m1.tiny">
Nov 16 00:42:20 user nova-compute[75826]:     <nova:memory>512</nova:memory>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:disk>1</nova:disk>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:swap>0</nova:swap>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:vcpus>1</nova:vcpus>
Nov 16 00:42:20 user nova-compute[75826]:   </nova:flavor>
Nov 16 00:42:20 user nova-compute[75826]:   <nova:owner>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:user uuid="159de45699cb47c68211051c7f62dae4">tempest-TaggedAttachmentsTest-2144441547-project-member</nova:user>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:project uuid="6e313a75f9fc4e91b5866d0228336b0b">tempest-TaggedAttachmentsTest-2144441547</nova:project>
Nov 16 00:42:20 user nova-compute[75826]:   </nova:owner>
Nov 16 00:42:20 user nova-compute[75826]:   <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:42:20 user nova-compute[75826]:   <nova:ports>
Nov 16 00:42:20 user nova-compute[75826]:     <nova:port uuid="ebabaf39-8f6c-4790-b555-271d5aef9db8">
Nov 16 00:42:20 user nova-compute[75826]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:42:20 user nova-compute[75826]:     </nova:port>
Nov 16 00:42:20 user nova-compute[75826]:   </nova:ports>
Nov 16 00:42:20 user nova-compute[75826]: </nova:instance>
Nov 16 00:42:20 user nova-compute[75826]:  {{(pid=75826) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Successfully updated port: e111e80e-fa44-4274-9130-728acbf11cce {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "refresh_cache-298aaae2-dd4e-412a-8afb-dfaafbd36964" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquired lock "refresh_cache-298aaae2-dd4e-412a-8afb-dfaafbd36964" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:42:20 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-vif-deleted-3ed8b208-8715-4d4b-8be5-7ad437342e88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:21 user nova-compute[75826]: INFO nova.compute.manager [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Neutron deleted interface 3ed8b208-8715-4d4b-8be5-7ad437342e88; detaching it from the instance and deleting it from the info cache
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.network.neutron [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Updating instance_info_cache with network_info: [{"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquired lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.objects.instance [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] Lazy-loading 'system_metadata' on Instance uuid 203da1ce-e5b1-4a16-a75e-e934c68d6e68 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Updating instance_info_cache with network_info: [{"id": "e111e80e-fa44-4274-9130-728acbf11cce", "address": "fa:16:3e:83:bc:24", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape111e80e-fa", "ovs_interfaceid": "e111e80e-fa44-4274-9130-728acbf11cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.objects.instance [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] Lazy-loading 'flavor' on Instance uuid 203da1ce-e5b1-4a16-a75e-e934c68d6e68 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Releasing lock "refresh_cache-298aaae2-dd4e-412a-8afb-dfaafbd36964" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Instance network_info: |[{"id": "e111e80e-fa44-4274-9130-728acbf11cce", "address": "fa:16:3e:83:bc:24", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape111e80e-fa", "ovs_interfaceid": "e111e80e-fa44-4274-9130-728acbf11cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Start _get_guest_xml network_info=[{"id": "e111e80e-fa44-4274-9130-728acbf11cce", "address": "fa:16:3e:83:bc:24", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape111e80e-fa", "ovs_interfaceid": "e111e80e-fa44-4274-9130-728acbf11cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:42:21 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:42:21 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1303689510',display_name='tempest-VolumesAdminNegativeTest-server-1303689510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1303689510',id=15,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6aa796a8fb4ea79988055543768456',ramdisk_id='',reservation_id='r-jzuu6kzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1306204197',owner_user_name='tempest-VolumesAdminNegativeTest-1306204197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:42:19Z,user_data=None,user_id='a021a407de284df491fe3dc7b0608403',uuid=298aaae2-dd4e-412a-8afb-dfaafbd36964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e111e80e-fa44-4274-9130-728acbf11cce", "address": "fa:16:3e:83:bc:24", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape111e80e-fa", "ovs_interfaceid": "e111e80e-fa44-4274-9130-728acbf11cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Converting VIF {"id": "e111e80e-fa44-4274-9130-728acbf11cce", "address": "fa:16:3e:83:bc:24", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape111e80e-fa", "ovs_interfaceid": "e111e80e-fa44-4274-9130-728acbf11cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:bc:24,bridge_name='br-int',has_traffic_filtering=True,id=e111e80e-fa44-4274-9130-728acbf11cce,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape111e80e-fa') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lazy-loading 'pci_devices' on Instance uuid 298aaae2-dd4e-412a-8afb-dfaafbd36964 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:42:21 user nova-compute[75826]:   <uuid>298aaae2-dd4e-412a-8afb-dfaafbd36964</uuid>
Nov 16 00:42:21 user nova-compute[75826]:   <name>instance-0000000f</name>
Nov 16 00:42:21 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:42:21 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:42:21 user nova-compute[75826]:   <metadata>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:42:21 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:42:21 user nova-compute[75826]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1303689510</nova:name>
Nov 16 00:42:21 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:42:21</nova:creationTime>
Nov 16 00:42:21 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:42:21 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:42:21 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:42:21 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:42:21 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:42:21 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:42:21 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:42:21 user nova-compute[75826]:       <nova:owner>
Nov 16 00:42:21 user nova-compute[75826]:         <nova:user uuid="a021a407de284df491fe3dc7b0608403">tempest-VolumesAdminNegativeTest-1306204197-project-member</nova:user>
Nov 16 00:42:21 user nova-compute[75826]:         <nova:project uuid="8f6aa796a8fb4ea79988055543768456">tempest-VolumesAdminNegativeTest-1306204197</nova:project>
Nov 16 00:42:21 user nova-compute[75826]:       </nova:owner>
Nov 16 00:42:21 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:42:21 user nova-compute[75826]:       <nova:ports>
Nov 16 00:42:21 user nova-compute[75826]:         <nova:port uuid="e111e80e-fa44-4274-9130-728acbf11cce">
Nov 16 00:42:21 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 00:42:21 user nova-compute[75826]:         </nova:port>
Nov 16 00:42:21 user nova-compute[75826]:       </nova:ports>
Nov 16 00:42:21 user nova-compute[75826]:     </nova:instance>
Nov 16 00:42:21 user nova-compute[75826]:   </metadata>
Nov 16 00:42:21 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:42:21 user nova-compute[75826]:     <system>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name="serial">298aaae2-dd4e-412a-8afb-dfaafbd36964</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name="uuid">298aaae2-dd4e-412a-8afb-dfaafbd36964</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:42:21 user nova-compute[75826]:     </system>
Nov 16 00:42:21 user nova-compute[75826]:   </sysinfo>
Nov 16 00:42:21 user nova-compute[75826]:   <os>
Nov 16 00:42:21 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:42:21 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:42:21 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:42:21 user nova-compute[75826]:   </os>
Nov 16 00:42:21 user nova-compute[75826]:   <features>
Nov 16 00:42:21 user nova-compute[75826]:     <acpi/>
Nov 16 00:42:21 user nova-compute[75826]:     <apic/>
Nov 16 00:42:21 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:42:21 user nova-compute[75826]:   </features>
Nov 16 00:42:21 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:42:21 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:42:21 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:42:21 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:42:21 user nova-compute[75826]:   </clock>
Nov 16 00:42:21 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:42:21 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:42:21 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:42:21 user nova-compute[75826]:   </cpu>
Nov 16 00:42:21 user nova-compute[75826]:   <devices>
Nov 16 00:42:21 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:42:21 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:42:21 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk"/>
Nov 16 00:42:21 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:42:21 user nova-compute[75826]:     </disk>
Nov 16 00:42:21 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:42:21 user nova-compute[75826]:       <mac address="fa:16:3e:83:bc:24"/>
Nov 16 00:42:21 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:42:21 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:42:21 user nova-compute[75826]:       <target dev="tape111e80e-fa"/>
Nov 16 00:42:21 user nova-compute[75826]:     </interface>
Nov 16 00:42:21 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:42:21 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/console.log" append="off"/>
Nov 16 00:42:21 user nova-compute[75826]:     </serial>
Nov 16 00:42:21 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:42:21 user nova-compute[75826]:     <video>
Nov 16 00:42:21 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:42:21 user nova-compute[75826]:     </video>
Nov 16 00:42:21 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:42:21 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:42:21 user nova-compute[75826]:     </rng>
Nov 16 00:42:21 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:42:21 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:42:21 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:42:21 user nova-compute[75826]:     </memballoon>
Nov 16 00:42:21 user nova-compute[75826]:   </devices>
Nov 16 00:42:21 user nova-compute[75826]: </domain>
Nov 16 00:42:21 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1303689510',display_name='tempest-VolumesAdminNegativeTest-server-1303689510',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1303689510',id=15,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f6aa796a8fb4ea79988055543768456',ramdisk_id='',reservation_id='r-jzuu6kzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1306204197',owner_user_name='tempest-VolumesAdminNegativeTest-1306204197-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:42:19Z,user_data=None,user_id='a021a407de284df491fe3dc7b0608403',uuid=298aaae2-dd4e-412a-8afb-dfaafbd36964,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e111e80e-fa44-4274-9130-728acbf11cce", "address": "fa:16:3e:83:bc:24", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape111e80e-fa", "ovs_interfaceid": "e111e80e-fa44-4274-9130-728acbf11cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Converting VIF {"id": "e111e80e-fa44-4274-9130-728acbf11cce", "address": "fa:16:3e:83:bc:24", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape111e80e-fa", "ovs_interfaceid": "e111e80e-fa44-4274-9130-728acbf11cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:bc:24,bridge_name='br-int',has_traffic_filtering=True,id=e111e80e-fa44-4274-9130-728acbf11cce,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape111e80e-fa') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG os_vif [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:bc:24,bridge_name='br-int',has_traffic_filtering=True,id=e111e80e-fa44-4274-9130-728acbf11cce,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape111e80e-fa') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba9af741-2cbb-5ea1-ab57-10a4dab16cd6', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape111e80e-fa, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape111e80e-fa, col_values=(('qos', UUID('365c8e64-adac-47f9-aee5-59c57756737f')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape111e80e-fa, col_values=(('external_ids', {'iface-id': 'e111e80e-fa44-4274-9130-728acbf11cce', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:bc:24', 'vm-uuid': '298aaae2-dd4e-412a-8afb-dfaafbd36964'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.objects.base [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] Object Instance<203da1ce-e5b1-4a16-a75e-e934c68d6e68> lazy-loaded attributes: system_metadata,flavor {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73313562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73313562',id=9,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcxgQNIwtABwmWWY66lpLW4FahMujB4sq8+awLbY3j4T0F+WRfv6pOgZdlOEfsFFgqQNg0M3KAfXMF/9LBbJOCDmKtj5c59DNwM9T0+YoH3Fun1L1tu/xueB5ab2B1nPg==',key_name='tempest-keypair-1839588636',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e313a75f9fc4e91b5866d0228336b0b',ramdisk_id='',reservation_id='r-1vf0ms0c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2144441547',owner_user_name='tempest-TaggedAttachmentsTest-2144441547-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:39:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='159de45699cb47c68211051c7f62dae4',uuid=203da1ce-e5b1-4a16-a75e-e934c68d6e68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.network.os_vif_util [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] Converting VIF {"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.network.os_vif_util [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed8b208-8715-4d4b-8be5-7ad437342e88,network=Network(bc4cb393-8a3e-4322-8f51-fc958631055d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed8b208-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:21 user nova-compute[75826]: INFO os_vif [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:bc:24,bridge_name='br-int',has_traffic_filtering=True,id=e111e80e-fa44-4274-9130-728acbf11cce,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape111e80e-fa')
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:26:dd:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap3ed8b208-87"/></interface> {{(pid=75826) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:26:dd:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap3ed8b208-87"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 16 00:42:21 user nova-compute[75826]:   <name>instance-00000009</name>
Nov 16 00:42:21 user nova-compute[75826]:   <uuid>203da1ce-e5b1-4a16-a75e-e934c68d6e68</uuid>
Nov 16 00:42:21 user nova-compute[75826]:   <metadata>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:42:21 user nova-compute[75826]:   <nova:package version="0.0.0"/>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:name>tempest-device-tagging-server-73313562</nova:name>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:creationTime>2023-11-16 00:42:20</nova:creationTime>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:flavor name="m1.tiny">
Nov 16 00:42:21 user nova-compute[75826]:     <nova:memory>512</nova:memory>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:disk>1</nova:disk>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:swap>0</nova:swap>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:vcpus>1</nova:vcpus>
Nov 16 00:42:21 user nova-compute[75826]:   </nova:flavor>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:owner>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:user uuid="159de45699cb47c68211051c7f62dae4">tempest-TaggedAttachmentsTest-2144441547-project-member</nova:user>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:project uuid="6e313a75f9fc4e91b5866d0228336b0b">tempest-TaggedAttachmentsTest-2144441547</nova:project>
Nov 16 00:42:21 user nova-compute[75826]:   </nova:owner>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:ports>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:port uuid="ebabaf39-8f6c-4790-b555-271d5aef9db8">
Nov 16 00:42:21 user nova-compute[75826]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:42:21 user nova-compute[75826]:     </nova:port>
Nov 16 00:42:21 user nova-compute[75826]:   </nova:ports>
Nov 16 00:42:21 user nova-compute[75826]: </nova:instance>
Nov 16 00:42:21 user nova-compute[75826]:   </metadata>
Nov 16 00:42:21 user nova-compute[75826]:   <memory unit='KiB'>524288</memory>
Nov 16 00:42:21 user nova-compute[75826]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 00:42:21 user nova-compute[75826]:   <vcpu placement='static'>1</vcpu>
Nov 16 00:42:21 user nova-compute[75826]:   <resource>
Nov 16 00:42:21 user nova-compute[75826]:     <partition>/machine</partition>
Nov 16 00:42:21 user nova-compute[75826]:   </resource>
Nov 16 00:42:21 user nova-compute[75826]:   <sysinfo type='smbios'>
Nov 16 00:42:21 user nova-compute[75826]:     <system>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name='version'>0.0.0</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name='serial'>203da1ce-e5b1-4a16-a75e-e934c68d6e68</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name='uuid'>203da1ce-e5b1-4a16-a75e-e934c68d6e68</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name='family'>Virtual Machine</entry>
Nov 16 00:42:21 user nova-compute[75826]:     </system>
Nov 16 00:42:21 user nova-compute[75826]:   </sysinfo>
Nov 16 00:42:21 user nova-compute[75826]:   <os>
Nov 16 00:42:21 user nova-compute[75826]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 00:42:21 user nova-compute[75826]:     <boot dev='hd'/>
Nov 16 00:42:21 user nova-compute[75826]:     <smbios mode='sysinfo'/>
Nov 16 00:42:21 user nova-compute[75826]:   </os>
Nov 16 00:42:21 user nova-compute[75826]:   <features>
Nov 16 00:42:21 user nova-compute[75826]:     <acpi/>
Nov 16 00:42:21 user nova-compute[75826]:     <apic/>
Nov 16 00:42:21 user nova-compute[75826]:     <vmcoreinfo state='on'/>
Nov 16 00:42:21 user nova-compute[75826]:   </features>
Nov 16 00:42:21 user nova-compute[75826]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 00:42:21 user nova-compute[75826]:     <model fallback='forbid'>Nehalem</model>
Nov 16 00:42:21 user nova-compute[75826]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 00:42:21 user nova-compute[75826]:     <feature policy='require' name='vme'/>
Nov 16 00:42:21 user nova-compute[75826]:     <feature policy='require' name='x2apic'/>
Nov 16 00:42:21 user nova-compute[75826]:     <feature policy='require' name='hypervisor'/>
Nov 16 00:42:21 user nova-compute[75826]:   </cpu>
Nov 16 00:42:21 user nova-compute[75826]:   <clock offset='utc'>
Nov 16 00:42:21 user nova-compute[75826]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 00:42:21 user nova-compute[75826]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 00:42:21 user nova-compute[75826]:     <timer name='hpet' present='no'/>
Nov 16 00:42:21 user nova-compute[75826]:   </clock>
Nov 16 00:42:21 user nova-compute[75826]:   <on_poweroff>destroy</on_poweroff>
Nov 16 00:42:21 user nova-compute[75826]:   <on_reboot>restart</on_reboot>
Nov 16 00:42:21 user nova-compute[75826]:   <on_crash>destroy</on_crash>
Nov 16 00:42:21 user nova-compute[75826]:   <devices>
Nov 16 00:42:21 user nova-compute[75826]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 00:42:21 user nova-compute[75826]:     <disk type='file' device='disk'>
Nov 16 00:42:21 user nova-compute[75826]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 00:42:21 user nova-compute[75826]:       <source file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk' index='2'/>
Nov 16 00:42:21 user nova-compute[75826]:       <backingStore type='file' index='3'>
Nov 16 00:42:21 user nova-compute[75826]:         <format type='raw'/>
Nov 16 00:42:21 user nova-compute[75826]:         <source file='/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e'/>
Nov 16 00:42:21 user nova-compute[75826]:         <backingStore/>
Nov 16 00:42:21 user nova-compute[75826]:       </backingStore>
Nov 16 00:42:21 user nova-compute[75826]:       <target dev='vda' bus='virtio'/>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='virtio-disk0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </disk>
Nov 16 00:42:21 user nova-compute[75826]:     <disk type='file' device='cdrom'>
Nov 16 00:42:21 user nova-compute[75826]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 00:42:21 user nova-compute[75826]:       <source file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk.config' index='1'/>
Nov 16 00:42:21 user nova-compute[75826]:       <backingStore/>
Nov 16 00:42:21 user nova-compute[75826]:       <target dev='hda' bus='ide'/>
Nov 16 00:42:21 user nova-compute[75826]:       <readonly/>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='ide0-0-0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </disk>
Nov 16 00:42:21 user nova-compute[75826]:     <controller type='usb' index='0' model='none'>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='usb'/>
Nov 16 00:42:21 user nova-compute[75826]:     </controller>
Nov 16 00:42:21 user nova-compute[75826]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='pci.0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </controller>
Nov 16 00:42:21 user nova-compute[75826]:     <controller type='ide' index='0'>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='ide'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 00:42:21 user nova-compute[75826]:     </controller>
Nov 16 00:42:21 user nova-compute[75826]:     <interface type='ethernet'>
Nov 16 00:42:21 user nova-compute[75826]:       <mac address='fa:16:3e:d3:17:39'/>
Nov 16 00:42:21 user nova-compute[75826]:       <target dev='tapebabaf39-8f'/>
Nov 16 00:42:21 user nova-compute[75826]:       <model type='virtio'/>
Nov 16 00:42:21 user nova-compute[75826]:       <mtu size='1442'/>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='net0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </interface>
Nov 16 00:42:21 user nova-compute[75826]:     <serial type='pty'>
Nov 16 00:42:21 user nova-compute[75826]:       <source path='/dev/pts/7'/>
Nov 16 00:42:21 user nova-compute[75826]:       <log file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/console.log' append='off'/>
Nov 16 00:42:21 user nova-compute[75826]:       <target type='isa-serial' port='0'>
Nov 16 00:42:21 user nova-compute[75826]:         <model name='isa-serial'/>
Nov 16 00:42:21 user nova-compute[75826]:       </target>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='serial0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </serial>
Nov 16 00:42:21 user nova-compute[75826]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 00:42:21 user nova-compute[75826]:       <source path='/dev/pts/7'/>
Nov 16 00:42:21 user nova-compute[75826]:       <log file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/console.log' append='off'/>
Nov 16 00:42:21 user nova-compute[75826]:       <target type='serial' port='0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='serial0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </console>
Nov 16 00:42:21 user nova-compute[75826]:     <input type='mouse' bus='ps2'>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='input0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </input>
Nov 16 00:42:21 user nova-compute[75826]:     <input type='keyboard' bus='ps2'>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='input1'/>
Nov 16 00:42:21 user nova-compute[75826]:     </input>
Nov 16 00:42:21 user nova-compute[75826]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 16 00:42:21 user nova-compute[75826]:       <listen type='address' address='0.0.0.0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </graphics>
Nov 16 00:42:21 user nova-compute[75826]:     <audio id='1' type='none'/>
Nov 16 00:42:21 user nova-compute[75826]:     <video>
Nov 16 00:42:21 user nova-compute[75826]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='video0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </video>
Nov 16 00:42:21 user nova-compute[75826]:     <memballoon model='virtio'>
Nov 16 00:42:21 user nova-compute[75826]:       <stats period='10'/>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='balloon0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </memballoon>
Nov 16 00:42:21 user nova-compute[75826]:     <rng model='virtio'>
Nov 16 00:42:21 user nova-compute[75826]:       <backend model='random'>/dev/urandom</backend>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='rng0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </rng>
Nov 16 00:42:21 user nova-compute[75826]:   </devices>
Nov 16 00:42:21 user nova-compute[75826]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 00:42:21 user nova-compute[75826]:     <label>libvirt-203da1ce-e5b1-4a16-a75e-e934c68d6e68</label>
Nov 16 00:42:21 user nova-compute[75826]:     <imagelabel>libvirt-203da1ce-e5b1-4a16-a75e-e934c68d6e68</imagelabel>
Nov 16 00:42:21 user nova-compute[75826]:   </seclabel>
Nov 16 00:42:21 user nova-compute[75826]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 00:42:21 user nova-compute[75826]:     <label>+64055:+108</label>
Nov 16 00:42:21 user nova-compute[75826]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 00:42:21 user nova-compute[75826]:   </seclabel>
Nov 16 00:42:21 user nova-compute[75826]: </domain>
Nov 16 00:42:21 user nova-compute[75826]:  {{(pid=75826) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:26:dd:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap3ed8b208-87"/></interface> {{(pid=75826) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:26:dd:4c"/><model type="virtio"/><mtu size="1442"/><target dev="tap3ed8b208-87"/></interface>not found in domain: <domain type='kvm' id='8'>
Nov 16 00:42:21 user nova-compute[75826]:   <name>instance-00000009</name>
Nov 16 00:42:21 user nova-compute[75826]:   <uuid>203da1ce-e5b1-4a16-a75e-e934c68d6e68</uuid>
Nov 16 00:42:21 user nova-compute[75826]:   <metadata>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:42:21 user nova-compute[75826]:   <nova:package version="0.0.0"/>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:name>tempest-device-tagging-server-73313562</nova:name>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:creationTime>2023-11-16 00:42:20</nova:creationTime>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:flavor name="m1.tiny">
Nov 16 00:42:21 user nova-compute[75826]:     <nova:memory>512</nova:memory>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:disk>1</nova:disk>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:swap>0</nova:swap>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:vcpus>1</nova:vcpus>
Nov 16 00:42:21 user nova-compute[75826]:   </nova:flavor>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:owner>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:user uuid="159de45699cb47c68211051c7f62dae4">tempest-TaggedAttachmentsTest-2144441547-project-member</nova:user>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:project uuid="6e313a75f9fc4e91b5866d0228336b0b">tempest-TaggedAttachmentsTest-2144441547</nova:project>
Nov 16 00:42:21 user nova-compute[75826]:   </nova:owner>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:ports>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:port uuid="ebabaf39-8f6c-4790-b555-271d5aef9db8">
Nov 16 00:42:21 user nova-compute[75826]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:42:21 user nova-compute[75826]:     </nova:port>
Nov 16 00:42:21 user nova-compute[75826]:   </nova:ports>
Nov 16 00:42:21 user nova-compute[75826]: </nova:instance>
Nov 16 00:42:21 user nova-compute[75826]:   </metadata>
Nov 16 00:42:21 user nova-compute[75826]:   <memory unit='KiB'>524288</memory>
Nov 16 00:42:21 user nova-compute[75826]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 16 00:42:21 user nova-compute[75826]:   <vcpu placement='static'>1</vcpu>
Nov 16 00:42:21 user nova-compute[75826]:   <resource>
Nov 16 00:42:21 user nova-compute[75826]:     <partition>/machine</partition>
Nov 16 00:42:21 user nova-compute[75826]:   </resource>
Nov 16 00:42:21 user nova-compute[75826]:   <sysinfo type='smbios'>
Nov 16 00:42:21 user nova-compute[75826]:     <system>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name='product'>OpenStack Nova</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name='version'>0.0.0</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name='serial'>203da1ce-e5b1-4a16-a75e-e934c68d6e68</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name='uuid'>203da1ce-e5b1-4a16-a75e-e934c68d6e68</entry>
Nov 16 00:42:21 user nova-compute[75826]:       <entry name='family'>Virtual Machine</entry>
Nov 16 00:42:21 user nova-compute[75826]:     </system>
Nov 16 00:42:21 user nova-compute[75826]:   </sysinfo>
Nov 16 00:42:21 user nova-compute[75826]:   <os>
Nov 16 00:42:21 user nova-compute[75826]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 16 00:42:21 user nova-compute[75826]:     <boot dev='hd'/>
Nov 16 00:42:21 user nova-compute[75826]:     <smbios mode='sysinfo'/>
Nov 16 00:42:21 user nova-compute[75826]:   </os>
Nov 16 00:42:21 user nova-compute[75826]:   <features>
Nov 16 00:42:21 user nova-compute[75826]:     <acpi/>
Nov 16 00:42:21 user nova-compute[75826]:     <apic/>
Nov 16 00:42:21 user nova-compute[75826]:     <vmcoreinfo state='on'/>
Nov 16 00:42:21 user nova-compute[75826]:   </features>
Nov 16 00:42:21 user nova-compute[75826]:   <cpu mode='custom' match='exact' check='full'>
Nov 16 00:42:21 user nova-compute[75826]:     <model fallback='forbid'>Nehalem</model>
Nov 16 00:42:21 user nova-compute[75826]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 16 00:42:21 user nova-compute[75826]:     <feature policy='require' name='vme'/>
Nov 16 00:42:21 user nova-compute[75826]:     <feature policy='require' name='x2apic'/>
Nov 16 00:42:21 user nova-compute[75826]:     <feature policy='require' name='hypervisor'/>
Nov 16 00:42:21 user nova-compute[75826]:   </cpu>
Nov 16 00:42:21 user nova-compute[75826]:   <clock offset='utc'>
Nov 16 00:42:21 user nova-compute[75826]:     <timer name='pit' tickpolicy='delay'/>
Nov 16 00:42:21 user nova-compute[75826]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 16 00:42:21 user nova-compute[75826]:     <timer name='hpet' present='no'/>
Nov 16 00:42:21 user nova-compute[75826]:   </clock>
Nov 16 00:42:21 user nova-compute[75826]:   <on_poweroff>destroy</on_poweroff>
Nov 16 00:42:21 user nova-compute[75826]:   <on_reboot>restart</on_reboot>
Nov 16 00:42:21 user nova-compute[75826]:   <on_crash>destroy</on_crash>
Nov 16 00:42:21 user nova-compute[75826]:   <devices>
Nov 16 00:42:21 user nova-compute[75826]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 16 00:42:21 user nova-compute[75826]:     <disk type='file' device='disk'>
Nov 16 00:42:21 user nova-compute[75826]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 16 00:42:21 user nova-compute[75826]:       <source file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk' index='2'/>
Nov 16 00:42:21 user nova-compute[75826]:       <backingStore type='file' index='3'>
Nov 16 00:42:21 user nova-compute[75826]:         <format type='raw'/>
Nov 16 00:42:21 user nova-compute[75826]:         <source file='/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e'/>
Nov 16 00:42:21 user nova-compute[75826]:         <backingStore/>
Nov 16 00:42:21 user nova-compute[75826]:       </backingStore>
Nov 16 00:42:21 user nova-compute[75826]:       <target dev='vda' bus='virtio'/>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='virtio-disk0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </disk>
Nov 16 00:42:21 user nova-compute[75826]:     <disk type='file' device='cdrom'>
Nov 16 00:42:21 user nova-compute[75826]:       <driver name='qemu' type='raw' cache='none'/>
Nov 16 00:42:21 user nova-compute[75826]:       <source file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/disk.config' index='1'/>
Nov 16 00:42:21 user nova-compute[75826]:       <backingStore/>
Nov 16 00:42:21 user nova-compute[75826]:       <target dev='hda' bus='ide'/>
Nov 16 00:42:21 user nova-compute[75826]:       <readonly/>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='ide0-0-0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </disk>
Nov 16 00:42:21 user nova-compute[75826]:     <controller type='usb' index='0' model='none'>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='usb'/>
Nov 16 00:42:21 user nova-compute[75826]:     </controller>
Nov 16 00:42:21 user nova-compute[75826]:     <controller type='pci' index='0' model='pci-root'>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='pci.0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </controller>
Nov 16 00:42:21 user nova-compute[75826]:     <controller type='ide' index='0'>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='ide'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 16 00:42:21 user nova-compute[75826]:     </controller>
Nov 16 00:42:21 user nova-compute[75826]:     <interface type='ethernet'>
Nov 16 00:42:21 user nova-compute[75826]:       <mac address='fa:16:3e:d3:17:39'/>
Nov 16 00:42:21 user nova-compute[75826]:       <target dev='tapebabaf39-8f'/>
Nov 16 00:42:21 user nova-compute[75826]:       <model type='virtio'/>
Nov 16 00:42:21 user nova-compute[75826]:       <mtu size='1442'/>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='net0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </interface>
Nov 16 00:42:21 user nova-compute[75826]:     <serial type='pty'>
Nov 16 00:42:21 user nova-compute[75826]:       <source path='/dev/pts/7'/>
Nov 16 00:42:21 user nova-compute[75826]:       <log file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/console.log' append='off'/>
Nov 16 00:42:21 user nova-compute[75826]:       <target type='isa-serial' port='0'>
Nov 16 00:42:21 user nova-compute[75826]:         <model name='isa-serial'/>
Nov 16 00:42:21 user nova-compute[75826]:       </target>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='serial0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </serial>
Nov 16 00:42:21 user nova-compute[75826]:     <console type='pty' tty='/dev/pts/7'>
Nov 16 00:42:21 user nova-compute[75826]:       <source path='/dev/pts/7'/>
Nov 16 00:42:21 user nova-compute[75826]:       <log file='/opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68/console.log' append='off'/>
Nov 16 00:42:21 user nova-compute[75826]:       <target type='serial' port='0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='serial0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </console>
Nov 16 00:42:21 user nova-compute[75826]:     <input type='mouse' bus='ps2'>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='input0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </input>
Nov 16 00:42:21 user nova-compute[75826]:     <input type='keyboard' bus='ps2'>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='input1'/>
Nov 16 00:42:21 user nova-compute[75826]:     </input>
Nov 16 00:42:21 user nova-compute[75826]:     <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0'>
Nov 16 00:42:21 user nova-compute[75826]:       <listen type='address' address='0.0.0.0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </graphics>
Nov 16 00:42:21 user nova-compute[75826]:     <audio id='1' type='none'/>
Nov 16 00:42:21 user nova-compute[75826]:     <video>
Nov 16 00:42:21 user nova-compute[75826]:       <model type='virtio' heads='1' primary='yes'/>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='video0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </video>
Nov 16 00:42:21 user nova-compute[75826]:     <memballoon model='virtio'>
Nov 16 00:42:21 user nova-compute[75826]:       <stats period='10'/>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='balloon0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </memballoon>
Nov 16 00:42:21 user nova-compute[75826]:     <rng model='virtio'>
Nov 16 00:42:21 user nova-compute[75826]:       <backend model='random'>/dev/urandom</backend>
Nov 16 00:42:21 user nova-compute[75826]:       <alias name='rng0'/>
Nov 16 00:42:21 user nova-compute[75826]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 16 00:42:21 user nova-compute[75826]:     </rng>
Nov 16 00:42:21 user nova-compute[75826]:   </devices>
Nov 16 00:42:21 user nova-compute[75826]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 16 00:42:21 user nova-compute[75826]:     <label>libvirt-203da1ce-e5b1-4a16-a75e-e934c68d6e68</label>
Nov 16 00:42:21 user nova-compute[75826]:     <imagelabel>libvirt-203da1ce-e5b1-4a16-a75e-e934c68d6e68</imagelabel>
Nov 16 00:42:21 user nova-compute[75826]:   </seclabel>
Nov 16 00:42:21 user nova-compute[75826]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 16 00:42:21 user nova-compute[75826]:     <label>+64055:+108</label>
Nov 16 00:42:21 user nova-compute[75826]:     <imagelabel>+64055:+108</imagelabel>
Nov 16 00:42:21 user nova-compute[75826]:   </seclabel>
Nov 16 00:42:21 user nova-compute[75826]: </domain>
Nov 16 00:42:21 user nova-compute[75826]:  {{(pid=75826) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 16 00:42:21 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Detaching interface fa:16:3e:26:dd:4c failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap3ed8b208-87' not found.
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73313562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73313562',id=9,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcxgQNIwtABwmWWY66lpLW4FahMujB4sq8+awLbY3j4T0F+WRfv6pOgZdlOEfsFFgqQNg0M3KAfXMF/9LBbJOCDmKtj5c59DNwM9T0+YoH3Fun1L1tu/xueB5ab2B1nPg==',key_name='tempest-keypair-1839588636',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e313a75f9fc4e91b5866d0228336b0b',ramdisk_id='',reservation_id='r-1vf0ms0c',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2144441547',owner_user_name='tempest-TaggedAttachmentsTest-2144441547-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:39:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='159de45699cb47c68211051c7f62dae4',uuid=203da1ce-e5b1-4a16-a75e-e934c68d6e68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.network.os_vif_util [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] Converting VIF {"id": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "address": "fa:16:3e:26:dd:4c", "network": {"id": "bc4cb393-8a3e-4322-8f51-fc958631055d", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1535359973", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed8b208-87", "ovs_interfaceid": "3ed8b208-8715-4d4b-8be5-7ad437342e88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.network.os_vif_util [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed8b208-8715-4d4b-8be5-7ad437342e88,network=Network(bc4cb393-8a3e-4322-8f51-fc958631055d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed8b208-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG os_vif [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed8b208-8715-4d4b-8be5-7ad437342e88,network=Network(bc4cb393-8a3e-4322-8f51-fc958631055d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed8b208-87') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ed8b208-87, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:42:21 user nova-compute[75826]: INFO os_vif [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:dd:4c,bridge_name='br-int',has_traffic_filtering=True,id=3ed8b208-8715-4d4b-8be5-7ad437342e88,network=Network(bc4cb393-8a3e-4322-8f51-fc958631055d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed8b208-87')
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [req-2de6307a-3381-4db8-942b-a9afe761bd17 req-419136aa-1939-433c-8115-b48501a1e8b5 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:42:21 user nova-compute[75826]:   <nova:package version="0.0.0"/>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:name>tempest-device-tagging-server-73313562</nova:name>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:creationTime>2023-11-16 00:42:21</nova:creationTime>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:flavor name="m1.tiny">
Nov 16 00:42:21 user nova-compute[75826]:     <nova:memory>512</nova:memory>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:disk>1</nova:disk>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:swap>0</nova:swap>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:vcpus>1</nova:vcpus>
Nov 16 00:42:21 user nova-compute[75826]:   </nova:flavor>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:owner>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:user uuid="159de45699cb47c68211051c7f62dae4">tempest-TaggedAttachmentsTest-2144441547-project-member</nova:user>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:project uuid="6e313a75f9fc4e91b5866d0228336b0b">tempest-TaggedAttachmentsTest-2144441547</nova:project>
Nov 16 00:42:21 user nova-compute[75826]:   </nova:owner>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:42:21 user nova-compute[75826]:   <nova:ports>
Nov 16 00:42:21 user nova-compute[75826]:     <nova:port uuid="ebabaf39-8f6c-4790-b555-271d5aef9db8">
Nov 16 00:42:21 user nova-compute[75826]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:42:21 user nova-compute[75826]:     </nova:port>
Nov 16 00:42:21 user nova-compute[75826]:   </nova:ports>
Nov 16 00:42:21 user nova-compute[75826]: </nova:instance>
Nov 16 00:42:21 user nova-compute[75826]:  {{(pid=75826) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] No VIF found with MAC fa:16:3e:83:bc:24, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Updating instance_info_cache with network_info: [{"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Releasing lock "refresh_cache-203da1ce-e5b1-4a16-a75e-e934c68d6e68" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4fd4ce16-d9dc-4de4-b1fa-0bb04069812b tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "interface-203da1ce-e5b1-4a16-a75e-e934c68d6e68-3ed8b208-8715-4d4b-8be5-7ad437342e88" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.826s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-6e873a1c-7a14-4c56-b854-b9bb0fcbc283 req-0e6b4b42-c1bd-4996-bf35-1734a128fd19 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Received event network-changed-e111e80e-fa44-4274-9130-728acbf11cce {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-6e873a1c-7a14-4c56-b854-b9bb0fcbc283 req-0e6b4b42-c1bd-4996-bf35-1734a128fd19 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Refreshing instance network info cache due to event network-changed-e111e80e-fa44-4274-9130-728acbf11cce. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6e873a1c-7a14-4c56-b854-b9bb0fcbc283 req-0e6b4b42-c1bd-4996-bf35-1734a128fd19 service nova] Acquiring lock "refresh_cache-298aaae2-dd4e-412a-8afb-dfaafbd36964" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6e873a1c-7a14-4c56-b854-b9bb0fcbc283 req-0e6b4b42-c1bd-4996-bf35-1734a128fd19 service nova] Acquired lock "refresh_cache-298aaae2-dd4e-412a-8afb-dfaafbd36964" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:42:21 user nova-compute[75826]: DEBUG nova.network.neutron [req-6e873a1c-7a14-4c56-b854-b9bb0fcbc283 req-0e6b4b42-c1bd-4996-bf35-1734a128fd19 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Refreshing network info cache for port e111e80e-fa44-4274-9130-728acbf11cce {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:42:22 user nova-compute[75826]: DEBUG nova.network.neutron [req-6e873a1c-7a14-4c56-b854-b9bb0fcbc283 req-0e6b4b42-c1bd-4996-bf35-1734a128fd19 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Updated VIF entry in instance network info cache for port e111e80e-fa44-4274-9130-728acbf11cce. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:42:22 user nova-compute[75826]: DEBUG nova.network.neutron [req-6e873a1c-7a14-4c56-b854-b9bb0fcbc283 req-0e6b4b42-c1bd-4996-bf35-1734a128fd19 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Updating instance_info_cache with network_info: [{"id": "e111e80e-fa44-4274-9130-728acbf11cce", "address": "fa:16:3e:83:bc:24", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape111e80e-fa", "ovs_interfaceid": "e111e80e-fa44-4274-9130-728acbf11cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6e873a1c-7a14-4c56-b854-b9bb0fcbc283 req-0e6b4b42-c1bd-4996-bf35-1734a128fd19 service nova] Releasing lock "refresh_cache-298aaae2-dd4e-412a-8afb-dfaafbd36964" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:42:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-dfe74a0c-9ff3-4e2d-af39-8843ed947b71 req-c7e9f637-3b81-4e1b-ad8e-125023340d27 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Received event network-vif-plugged-e111e80e-fa44-4274-9130-728acbf11cce {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dfe74a0c-9ff3-4e2d-af39-8843ed947b71 req-c7e9f637-3b81-4e1b-ad8e-125023340d27 service nova] Acquiring lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dfe74a0c-9ff3-4e2d-af39-8843ed947b71 req-c7e9f637-3b81-4e1b-ad8e-125023340d27 service nova] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dfe74a0c-9ff3-4e2d-af39-8843ed947b71 req-c7e9f637-3b81-4e1b-ad8e-125023340d27 service nova] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-dfe74a0c-9ff3-4e2d-af39-8843ed947b71 req-c7e9f637-3b81-4e1b-ad8e-125023340d27 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] No waiting events found dispatching network-vif-plugged-e111e80e-fa44-4274-9130-728acbf11cce {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:23 user nova-compute[75826]: WARNING nova.compute.manager [req-dfe74a0c-9ff3-4e2d-af39-8843ed947b71 req-c7e9f637-3b81-4e1b-ad8e-125023340d27 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Received unexpected event network-vif-plugged-e111e80e-fa44-4274-9130-728acbf11cce for instance with vm_state building and task_state spawning.
Nov 16 00:42:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-dfe74a0c-9ff3-4e2d-af39-8843ed947b71 req-c7e9f637-3b81-4e1b-ad8e-125023340d27 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Received event network-vif-plugged-e111e80e-fa44-4274-9130-728acbf11cce {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dfe74a0c-9ff3-4e2d-af39-8843ed947b71 req-c7e9f637-3b81-4e1b-ad8e-125023340d27 service nova] Acquiring lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dfe74a0c-9ff3-4e2d-af39-8843ed947b71 req-c7e9f637-3b81-4e1b-ad8e-125023340d27 service nova] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dfe74a0c-9ff3-4e2d-af39-8843ed947b71 req-c7e9f637-3b81-4e1b-ad8e-125023340d27 service nova] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-dfe74a0c-9ff3-4e2d-af39-8843ed947b71 req-c7e9f637-3b81-4e1b-ad8e-125023340d27 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] No waiting events found dispatching network-vif-plugged-e111e80e-fa44-4274-9130-728acbf11cce {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:23 user nova-compute[75826]: WARNING nova.compute.manager [req-dfe74a0c-9ff3-4e2d-af39-8843ed947b71 req-c7e9f637-3b81-4e1b-ad8e-125023340d27 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Received unexpected event network-vif-plugged-e111e80e-fa44-4274-9130-728acbf11cce for instance with vm_state building and task_state spawning.
Nov 16 00:42:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:42:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:42:25 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Instance spawned successfully.
Nov 16 00:42:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:42:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:25 user nova-compute[75826]: INFO nova.compute.manager [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Took 5.94 seconds to spawn the instance on the hypervisor.
Nov 16 00:42:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:42:25 user nova-compute[75826]: INFO nova.compute.manager [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Took 6.82 seconds to build instance.
Nov 16 00:42:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6e732a0f-c8da-4530-bc4e-340c7b51b12c tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.961s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 00:42:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:42:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:42:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-6f82dde6-f564-4578-873b-200bbef261cb req-b962f637-a2e4-41f9-9937-48a302fd3988 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Received event network-changed-236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-6f82dde6-f564-4578-873b-200bbef261cb req-b962f637-a2e4-41f9-9937-48a302fd3988 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Refreshing instance network info cache due to event network-changed-236b01b5-75c3-44de-9672-6fc73939c4a0. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:42:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6f82dde6-f564-4578-873b-200bbef261cb req-b962f637-a2e4-41f9-9937-48a302fd3988 service nova] Acquiring lock "refresh_cache-1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:42:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6f82dde6-f564-4578-873b-200bbef261cb req-b962f637-a2e4-41f9-9937-48a302fd3988 service nova] Acquired lock "refresh_cache-1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:42:33 user nova-compute[75826]: DEBUG nova.network.neutron [req-6f82dde6-f564-4578-873b-200bbef261cb req-b962f637-a2e4-41f9-9937-48a302fd3988 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Refreshing network info cache for port 236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:42:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG nova.network.neutron [req-6f82dde6-f564-4578-873b-200bbef261cb req-b962f637-a2e4-41f9-9937-48a302fd3988 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Updated VIF entry in instance network info cache for port 236b01b5-75c3-44de-9672-6fc73939c4a0. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG nova.network.neutron [req-6f82dde6-f564-4578-873b-200bbef261cb req-b962f637-a2e4-41f9-9937-48a302fd3988 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Updating instance_info_cache with network_info: [{"id": "236b01b5-75c3-44de-9672-6fc73939c4a0", "address": "fa:16:3e:b4:52:8d", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236b01b5-75", "ovs_interfaceid": "236b01b5-75c3-44de-9672-6fc73939c4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6f82dde6-f564-4578-873b-200bbef261cb req-b962f637-a2e4-41f9-9937-48a302fd3988 service nova] Releasing lock "refresh_cache-1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG nova.objects.instance [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lazy-loading 'flavor' on Instance uuid 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:34 user nova-compute[75826]: INFO nova.compute.manager [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Attaching volume dd604f3d-ac35-420a-a0bb-b6b199bce96f to /dev/vdb
Nov 16 00:42:34 user nova-compute[75826]: DEBUG os_brick.utils [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[963cc6b8-ee27-4ce7-a16f-07d99a0fd55e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dee4d3-042c-4e1a-b304-6f08430d72e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f15f2b0-e56a-4061-8080-02a3b0bc4c3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd68f5f-7110-4974-ae6a-6274f28098f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:42:34 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:42:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f49dbc-9a72-4625-9db2-988d85f3760f]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG os_brick.utils [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:42:34 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Updating existing volume attachment record: 5fefb7f4-2ddc-4b38-8bc0-ccc1170af7b9 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:42:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Acquiring lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Acquiring lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:36 user nova-compute[75826]: INFO nova.compute.manager [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Terminating instance
Nov 16 00:42:36 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG nova.compute.manager [req-e33201cf-7b7f-461a-a3f7-0e0598116dcc req-b9be3e28-ce09-4a35-a558-2121bf341bd9 service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Received event network-vif-unplugged-72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e33201cf-7b7f-461a-a3f7-0e0598116dcc req-b9be3e28-ce09-4a35-a558-2121bf341bd9 service nova] Acquiring lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e33201cf-7b7f-461a-a3f7-0e0598116dcc req-b9be3e28-ce09-4a35-a558-2121bf341bd9 service nova] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e33201cf-7b7f-461a-a3f7-0e0598116dcc req-b9be3e28-ce09-4a35-a558-2121bf341bd9 service nova] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG nova.compute.manager [req-e33201cf-7b7f-461a-a3f7-0e0598116dcc req-b9be3e28-ce09-4a35-a558-2121bf341bd9 service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] No waiting events found dispatching network-vif-unplugged-72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG nova.compute.manager [req-e33201cf-7b7f-461a-a3f7-0e0598116dcc req-b9be3e28-ce09-4a35-a558-2121bf341bd9 service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Received event network-vif-unplugged-72a2f5c9-f73f-4207-926b-8b82e845f8b3 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:42:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Instance destroyed successfully.
Nov 16 00:42:37 user nova-compute[75826]: DEBUG nova.objects.instance [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lazy-loading 'resources' on Instance uuid 4e2d6eb9-c31e-487c-807d-3bb8460f3a02 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-2018062246',display_name='tempest-VolumesAssistedSnapshotsTest-server-2018062246',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-2018062246',id=10,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGbI5XPIj5z6tD/lSyhAEMQ0iacx2Ox1OOXcMUbwg8nG9WxAU7I62dVK5+ef9hQnQ214Q4P2hN5WmiV+aO1UX1J2F12sai4ecnn6o5ShQ28XYgZtOG0ii2O4E2YlmTdsQ==',key_name='tempest-keypair-1261404254',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6fe51852d2e4213876d2bcba378c427',ramdisk_id='',reservation_id='r-ghrp2lf7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-695087630',owner_user_name='tempest-VolumesAssistedSnapshotsTest-695087630-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:39:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f3b20fdea3b44754b31ffb9baee27bbf',uuid=4e2d6eb9-c31e-487c-807d-3bb8460f3a02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "address": "fa:16:3e:78:d0:a7", "network": {"id": "dad71101-cc46-4510-bd10-70173e431b9f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-774900563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe51852d2e4213876d2bcba378c427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2f5c9-f7", "ovs_interfaceid": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Converting VIF {"id": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "address": "fa:16:3e:78:d0:a7", "network": {"id": "dad71101-cc46-4510-bd10-70173e431b9f", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-774900563-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.169", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6fe51852d2e4213876d2bcba378c427", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a2f5c9-f7", "ovs_interfaceid": "72a2f5c9-f73f-4207-926b-8b82e845f8b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:d0:a7,bridge_name='br-int',has_traffic_filtering=True,id=72a2f5c9-f73f-4207-926b-8b82e845f8b3,network=Network(dad71101-cc46-4510-bd10-70173e431b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a2f5c9-f7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG os_vif [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d0:a7,bridge_name='br-int',has_traffic_filtering=True,id=72a2f5c9-f73f-4207-926b-8b82e845f8b3,network=Network(dad71101-cc46-4510-bd10-70173e431b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a2f5c9-f7') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72a2f5c9-f7, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67abd51b-7299-4c95-9c0e-cedc4c1cfdb2) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:37 user nova-compute[75826]: INFO os_vif [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d0:a7,bridge_name='br-int',has_traffic_filtering=True,id=72a2f5c9-f73f-4207-926b-8b82e845f8b3,network=Network(dad71101-cc46-4510-bd10-70173e431b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a2f5c9-f7')
Nov 16 00:42:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Deleting instance files /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02_del
Nov 16 00:42:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Deletion of /opt/stack/data/nova/instances/4e2d6eb9-c31e-487c-807d-3bb8460f3a02_del complete
Nov 16 00:42:37 user nova-compute[75826]: INFO nova.compute.manager [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 16 00:42:37 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:42:37 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:42:38 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:38 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Took 0.84 seconds to deallocate network for instance.
Nov 16 00:42:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:39 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:42:39 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:42:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-e9d971bb-204c-49e5-84ba-6ac168eae978 req-1e204444-b990-40bb-9b13-71ac8c34d63b service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Received event network-vif-plugged-72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e9d971bb-204c-49e5-84ba-6ac168eae978 req-1e204444-b990-40bb-9b13-71ac8c34d63b service nova] Acquiring lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e9d971bb-204c-49e5-84ba-6ac168eae978 req-1e204444-b990-40bb-9b13-71ac8c34d63b service nova] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e9d971bb-204c-49e5-84ba-6ac168eae978 req-1e204444-b990-40bb-9b13-71ac8c34d63b service nova] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-e9d971bb-204c-49e5-84ba-6ac168eae978 req-1e204444-b990-40bb-9b13-71ac8c34d63b service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] No waiting events found dispatching network-vif-plugged-72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:39 user nova-compute[75826]: WARNING nova.compute.manager [req-e9d971bb-204c-49e5-84ba-6ac168eae978 req-1e204444-b990-40bb-9b13-71ac8c34d63b service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Received unexpected event network-vif-plugged-72a2f5c9-f73f-4207-926b-8b82e845f8b3 for instance with vm_state deleted and task_state None.
Nov 16 00:42:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-e9d971bb-204c-49e5-84ba-6ac168eae978 req-1e204444-b990-40bb-9b13-71ac8c34d63b service nova] [instance: 4e2d6eb9-c31e-487c-807d-3bb8460f3a02] Received event network-vif-deleted-72a2f5c9-f73f-4207-926b-8b82e845f8b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.593s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:39 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Deleted allocations for instance 4e2d6eb9-c31e-487c-807d-3bb8460f3a02
Nov 16 00:42:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c5717c3-cb61-4fe9-a21f-e74615909e84 tempest-VolumesAssistedSnapshotsTest-695087630 tempest-VolumesAssistedSnapshotsTest-695087630-project-member] Lock "4e2d6eb9-c31e-487c-807d-3bb8460f3a02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.648s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPdjCgiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:42:40 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:42:40 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:42:40 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d499bb3-7446-46fc-9aca-75a645d400d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:42:40 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.038s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dfc0c8-67c8-4ee5-9706-a22d385451b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f] added
Nov 16 00:42:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c58711-65c7-46e7-9334-42ca458c8225]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31b58d6-7797-4e6d-bf6d-e0b4f78762f0]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xPdjCgiO {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xPdjCgiO" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[70529cdc-ab3a-4d82-8063-77927c6b932f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xPdjCgiO'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94871a4-2978-4acf-ae70-c6828632e87f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c80742d-d80f-4325-ae21-99aa137a480f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:42:40 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:42:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:42:40 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:42:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f643d7-b3bd-4386-9159-99daa0087545]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f, portal: 172.16.0.220,3260]
Nov 16 00:42:40 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f, portal: 172.16.0.220,3260] successful.
Nov 16 00:42:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8784d23e-c00a-47ac-bc80-4f6c3e93a23d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23dfc49-220d-4b58-901b-3b7035d93565]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:42:40 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:42:40 user nova-compute[75826]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f (non-flash)
Nov 16 00:42:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:42:40 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:42:40 user nova-compute[75826]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f (non-flash)
Nov 16 00:42:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4239ecab-1504-417b-a483-75ec4383b606]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:42:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPdjCgiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:42:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:42:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23262663661616265', 'path': '/dev/sdc'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:42:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262663661616265', 'path': '/dev/sdc'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:42:41 user nova-compute[75826]: DEBUG nova.objects.instance [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lazy-loading 'flavor' on Instance uuid 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:42:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:42:41 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:42:41 user nova-compute[75826]:   <source dev="/dev/sdc"/>
Nov 16 00:42:41 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:42:41 user nova-compute[75826]:   <serial>dd604f3d-ac35-420a-a0bb-b6b199bce96f</serial>
Nov 16 00:42:41 user nova-compute[75826]: </disk>
Nov 16 00:42:41 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:42:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:42:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:42:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] No VIF found with MAC fa:16:3e:b4:52:8d, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:42:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3c34213b-7c1f-4dbd-8e0d-40fecd4926f8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.801s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:45 user nova-compute[75826]: INFO nova.compute.manager [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Detaching volume dd604f3d-ac35-420a-a0bb-b6b199bce96f
Nov 16 00:42:45 user nova-compute[75826]: INFO nova.virt.block_device [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Attempting to driver detach volume dd604f3d-ac35-420a-a0bb-b6b199bce96f from mountpoint /dev/vdb
Nov 16 00:42:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Attempting to detach device vdb from instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:42:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:42:45 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:42:45 user nova-compute[75826]:   <source dev="/dev/sdc"/>
Nov 16 00:42:45 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:42:45 user nova-compute[75826]:   <serial>dd604f3d-ac35-420a-a0bb-b6b199bce96f</serial>
Nov 16 00:42:45 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:42:45 user nova-compute[75826]: </disk>
Nov 16 00:42:45 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:42:45 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Successfully detached device vdb from instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 from the persistent domain config.
Nov 16 00:42:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:42:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:42:45 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:42:45 user nova-compute[75826]:   <source dev="/dev/sdc"/>
Nov 16 00:42:45 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:42:45 user nova-compute[75826]:   <serial>dd604f3d-ac35-420a-a0bb-b6b199bce96f</serial>
Nov 16 00:42:45 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:42:45 user nova-compute[75826]: </disk>
Nov 16 00:42:45 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:42:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:42:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:42:50 user nova-compute[75826]: INFO nova.compute.claims [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Claim successful on node user
Nov 16 00:42:50 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:50 user nova-compute[75826]: INFO nova.compute.manager [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Terminating instance
Nov 16 00:42:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.604s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG nova.network.neutron [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:50 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:42:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:42:50 user nova-compute[75826]: DEBUG nova.policy [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '055179a465cc4327b4ce68af5018608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0d81c4b6d0415681092d61ea35de51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG nova.compute.manager [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:42:51 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Creating image(s)
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "/opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "/opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-c0428563-93b3-4cdc-8b5f-f877b9c13249 req-f6803f36-10ec-4214-b9e8-beccd93a89ec service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-vif-unplugged-ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c0428563-93b3-4cdc-8b5f-f877b9c13249 req-f6803f36-10ec-4214-b9e8-beccd93a89ec service nova] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c0428563-93b3-4cdc-8b5f-f877b9c13249 req-f6803f36-10ec-4214-b9e8-beccd93a89ec service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c0428563-93b3-4cdc-8b5f-f877b9c13249 req-f6803f36-10ec-4214-b9e8-beccd93a89ec service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-c0428563-93b3-4cdc-8b5f-f877b9c13249 req-f6803f36-10ec-4214-b9e8-beccd93a89ec service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] No waiting events found dispatching network-vif-unplugged-ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-c0428563-93b3-4cdc-8b5f-f877b9c13249 req-f6803f36-10ec-4214-b9e8-beccd93a89ec service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-vif-unplugged-ebabaf39-8f6c-4790-b555-271d5aef9db8 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:42:51 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Instance destroyed successfully.
Nov 16 00:42:51 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lazy-loading 'resources' on Instance uuid 203da1ce-e5b1-4a16-a75e-e934c68d6e68 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.218s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:39:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-73313562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-73313562',id=9,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNcxgQNIwtABwmWWY66lpLW4FahMujB4sq8+awLbY3j4T0F+WRfv6pOgZdlOEfsFFgqQNg0M3KAfXMF/9LBbJOCDmKtj5c59DNwM9T0+YoH3Fun1L1tu/xueB5ab2B1nPg==',key_name='tempest-keypair-1839588636',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e313a75f9fc4e91b5866d0228336b0b',ramdisk_id='',reservation_id='r-1vf0ms0c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-2144441547',owner_user_name='tempest-TaggedAttachmentsTest-2144441547-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:39:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='159de45699cb47c68211051c7f62dae4',uuid=203da1ce-e5b1-4a16-a75e-e934c68d6e68,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converting VIF {"id": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "address": "fa:16:3e:d3:17:39", "network": {"id": "5387e407-2541-49fb-a8ba-c80d318e4b2f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-862004612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.9", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e313a75f9fc4e91b5866d0228336b0b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebabaf39-8f", "ovs_interfaceid": "ebabaf39-8f6c-4790-b555-271d5aef9db8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:17:39,bridge_name='br-int',has_traffic_filtering=True,id=ebabaf39-8f6c-4790-b555-271d5aef9db8,network=Network(5387e407-2541-49fb-a8ba-c80d318e4b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebabaf39-8f') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG os_vif [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:17:39,bridge_name='br-int',has_traffic_filtering=True,id=ebabaf39-8f6c-4790-b555-271d5aef9db8,network=Network(5387e407-2541-49fb-a8ba-c80d318e4b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebabaf39-8f') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebabaf39-8f, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk 1073741824" returned: 0 in 0.064s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7baf9d5-9801-44b0-9f38-806749c5188c) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:51 user nova-compute[75826]: INFO os_vif [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:17:39,bridge_name='br-int',has_traffic_filtering=True,id=ebabaf39-8f6c-4790-b555-271d5aef9db8,network=Network(5387e407-2541-49fb-a8ba-c80d318e4b2f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebabaf39-8f')
Nov 16 00:42:51 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Deleting instance files /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68_del
Nov 16 00:42:51 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Deletion of /opt/stack/data/nova/instances/203da1ce-e5b1-4a16-a75e-e934c68d6e68_del complete
Nov 16 00:42:51 user nova-compute[75826]: INFO nova.compute.manager [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.227s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:42:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:52 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Cannot resize image /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:42:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:42:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Ensure instance console log exists: /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:42:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:52 user nova-compute[75826]: DEBUG nova.network.neutron [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Successfully created port: 850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:42:52 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:52 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Took 1.06 seconds to deallocate network for instance.
Nov 16 00:42:52 user nova-compute[75826]: DEBUG nova.compute.manager [req-a31e6434-ce8d-4912-970e-d98d6f55f01f req-ffaef76e-dea5-40d1-aea2-33430c7d18c8 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-vif-deleted-ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:53 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Deleted allocations for instance 203da1ce-e5b1-4a16-a75e-e934c68d6e68
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Successfully updated port: 850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-5c8d8595-e6f1-4382-9858-193a5461bcc8 req-3a16a609-697b-44cc-9206-ce651471c944 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received event network-vif-plugged-ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5c8d8595-e6f1-4382-9858-193a5461bcc8 req-3a16a609-697b-44cc-9206-ce651471c944 service nova] Acquiring lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5c8d8595-e6f1-4382-9858-193a5461bcc8 req-3a16a609-697b-44cc-9206-ce651471c944 service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5c8d8595-e6f1-4382-9858-193a5461bcc8 req-3a16a609-697b-44cc-9206-ce651471c944 service nova] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-5c8d8595-e6f1-4382-9858-193a5461bcc8 req-3a16a609-697b-44cc-9206-ce651471c944 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] No waiting events found dispatching network-vif-plugged-ebabaf39-8f6c-4790-b555-271d5aef9db8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:53 user nova-compute[75826]: WARNING nova.compute.manager [req-5c8d8595-e6f1-4382-9858-193a5461bcc8 req-3a16a609-697b-44cc-9206-ce651471c944 service nova] [instance: 203da1ce-e5b1-4a16-a75e-e934c68d6e68] Received unexpected event network-vif-plugged-ebabaf39-8f6c-4790-b555-271d5aef9db8 for instance with vm_state deleted and task_state None.
Nov 16 00:42:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "refresh_cache-4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquired lock "refresh_cache-4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e67eeff7-353e-4388-9483-913e9651c173 tempest-TaggedAttachmentsTest-2144441547 tempest-TaggedAttachmentsTest-2144441547-project-member] Lock "203da1ce-e5b1-4a16-a75e-e934c68d6e68" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.742s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Updating instance_info_cache with network_info: [{"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Releasing lock "refresh_cache-4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Instance network_info: |[{"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Start _get_guest_xml network_info=[{"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:42:53 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:42:53 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-361931967',display_name='tempest-tempest.common.compute-instance-361931967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-361931967',id=16,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU0KcpmTuTErG9NaY3SZVpF+AX/WxeRMWWQl0MA4gmj4gnXvVoemz++PrFyKR2DQrAESNN4t09s9GqnpqMN1S2wts2aQeEh/Ie9G5hq2y0lGk8+aBwuQnpRMCQq+GtUtg==',key_name='tempest-keypair-1288954721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-mt01qiuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.objects.instance [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lazy-loading 'pci_devices' on Instance uuid 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:42:53 user nova-compute[75826]:   <uuid>4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8</uuid>
Nov 16 00:42:53 user nova-compute[75826]:   <name>instance-00000010</name>
Nov 16 00:42:53 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:42:53 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:42:53 user nova-compute[75826]:   <metadata>
Nov 16 00:42:53 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:42:53 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:42:53 user nova-compute[75826]:       <nova:name>tempest-tempest.common.compute-instance-361931967</nova:name>
Nov 16 00:42:53 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:42:53</nova:creationTime>
Nov 16 00:42:53 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:42:53 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:42:53 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:42:53 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:42:53 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:42:53 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:42:53 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:42:53 user nova-compute[75826]:       <nova:owner>
Nov 16 00:42:53 user nova-compute[75826]:         <nova:user uuid="055179a465cc4327b4ce68af5018608c">tempest-ServerActionsTestOtherA-329506797-project-member</nova:user>
Nov 16 00:42:53 user nova-compute[75826]:         <nova:project uuid="4d0d81c4b6d0415681092d61ea35de51">tempest-ServerActionsTestOtherA-329506797</nova:project>
Nov 16 00:42:53 user nova-compute[75826]:       </nova:owner>
Nov 16 00:42:53 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:42:53 user nova-compute[75826]:       <nova:ports>
Nov 16 00:42:53 user nova-compute[75826]:         <nova:port uuid="850f4dad-cf10-4839-a39f-16868c918dee">
Nov 16 00:42:53 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 00:42:53 user nova-compute[75826]:         </nova:port>
Nov 16 00:42:53 user nova-compute[75826]:       </nova:ports>
Nov 16 00:42:53 user nova-compute[75826]:     </nova:instance>
Nov 16 00:42:53 user nova-compute[75826]:   </metadata>
Nov 16 00:42:53 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:42:53 user nova-compute[75826]:     <system>
Nov 16 00:42:53 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:42:53 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:42:53 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:42:53 user nova-compute[75826]:       <entry name="serial">4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8</entry>
Nov 16 00:42:53 user nova-compute[75826]:       <entry name="uuid">4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8</entry>
Nov 16 00:42:53 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:42:53 user nova-compute[75826]:     </system>
Nov 16 00:42:53 user nova-compute[75826]:   </sysinfo>
Nov 16 00:42:53 user nova-compute[75826]:   <os>
Nov 16 00:42:53 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:42:53 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:42:53 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:42:53 user nova-compute[75826]:   </os>
Nov 16 00:42:53 user nova-compute[75826]:   <features>
Nov 16 00:42:53 user nova-compute[75826]:     <acpi/>
Nov 16 00:42:53 user nova-compute[75826]:     <apic/>
Nov 16 00:42:53 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:42:53 user nova-compute[75826]:   </features>
Nov 16 00:42:53 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:42:53 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:42:53 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:42:53 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:42:53 user nova-compute[75826]:   </clock>
Nov 16 00:42:53 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:42:53 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:42:53 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:42:53 user nova-compute[75826]:   </cpu>
Nov 16 00:42:53 user nova-compute[75826]:   <devices>
Nov 16 00:42:53 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:42:53 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:42:53 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk"/>
Nov 16 00:42:53 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:42:53 user nova-compute[75826]:     </disk>
Nov 16 00:42:53 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:42:53 user nova-compute[75826]:       <mac address="fa:16:3e:7c:72:81"/>
Nov 16 00:42:53 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:42:53 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:42:53 user nova-compute[75826]:       <target dev="tap850f4dad-cf"/>
Nov 16 00:42:53 user nova-compute[75826]:     </interface>
Nov 16 00:42:53 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:42:53 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/console.log" append="off"/>
Nov 16 00:42:53 user nova-compute[75826]:     </serial>
Nov 16 00:42:53 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:42:53 user nova-compute[75826]:     <video>
Nov 16 00:42:53 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:42:53 user nova-compute[75826]:     </video>
Nov 16 00:42:53 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:42:53 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:42:53 user nova-compute[75826]:     </rng>
Nov 16 00:42:53 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:42:53 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:42:53 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:42:53 user nova-compute[75826]:     </memballoon>
Nov 16 00:42:53 user nova-compute[75826]:   </devices>
Nov 16 00:42:53 user nova-compute[75826]: </domain>
Nov 16 00:42:53 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-361931967',display_name='tempest-tempest.common.compute-instance-361931967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-361931967',id=16,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU0KcpmTuTErG9NaY3SZVpF+AX/WxeRMWWQl0MA4gmj4gnXvVoemz++PrFyKR2DQrAESNN4t09s9GqnpqMN1S2wts2aQeEh/Ie9G5hq2y0lGk8+aBwuQnpRMCQq+GtUtg==',key_name='tempest-keypair-1288954721',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-mt01qiuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:42:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG os_vif [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.objects.instance [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lazy-loading 'flavor' on Instance uuid 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15f68b59-ba54-5f05-9b2c-f2a715f09b98', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap850f4dad-cf, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap850f4dad-cf, col_values=(('qos', UUID('bc9318b4-4b24-43fe-b2bb-d33c40a81aec')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap850f4dad-cf, col_values=(('external_ids', {'iface-id': '850f4dad-cf10-4839-a39f-16868c918dee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:72:81', 'vm-uuid': '4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:53 user nova-compute[75826]: INFO os_vif [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf')
Nov 16 00:42:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:42:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No VIF found with MAC fa:16:3e:7c:72:81, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:54 user nova-compute[75826]: INFO nova.compute.manager [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Attaching volume 48b289f4-4b30-4d11-8683-5419d02afa18 to /dev/vdb
Nov 16 00:42:54 user nova-compute[75826]: DEBUG os_brick.utils [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04eff0c-b82a-496c-9d45-2a0dc60bb435]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1e45fc-bb2b-4aed-9d0a-4f4dccfacad7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1d77a4-aef2-4f88-a176-8ce83e823297]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[056cd9bf-85ec-4eb3-8c0c-3480818c2f94]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:42:54 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:42:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f0af65-2879-4a13-b7ad-6f8394e27269]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG os_brick.utils [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:42:54 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating existing volume attachment record: 118a9bc0-7696-427d-b2b3-1ff774998974 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-85ccdc92-574a-4d62-aec5-323f6cfcdc5e req-1f46b3c9-e081-4435-97ad-0b3708e3c532 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-changed-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-85ccdc92-574a-4d62-aec5-323f6cfcdc5e req-1f46b3c9-e081-4435-97ad-0b3708e3c532 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Refreshing instance network info cache due to event network-changed-850f4dad-cf10-4839-a39f-16868c918dee. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-85ccdc92-574a-4d62-aec5-323f6cfcdc5e req-1f46b3c9-e081-4435-97ad-0b3708e3c532 service nova] Acquiring lock "refresh_cache-4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-85ccdc92-574a-4d62-aec5-323f6cfcdc5e req-1f46b3c9-e081-4435-97ad-0b3708e3c532 service nova] Acquired lock "refresh_cache-4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG nova.network.neutron [req-85ccdc92-574a-4d62-aec5-323f6cfcdc5e req-1f46b3c9-e081-4435-97ad-0b3708e3c532 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Refreshing network info cache for port 850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-85ccdc92-574a-4d62-aec5-323f6cfcdc5e req-1f46b3c9-e081-4435-97ad-0b3708e3c532 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Updated VIF entry in instance network info cache for port 850f4dad-cf10-4839-a39f-16868c918dee. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-85ccdc92-574a-4d62-aec5-323f6cfcdc5e req-1f46b3c9-e081-4435-97ad-0b3708e3c532 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Updating instance_info_cache with network_info: [{"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-85ccdc92-574a-4d62-aec5-323f6cfcdc5e req-1f46b3c9-e081-4435-97ad-0b3708e3c532 service nova] Releasing lock "refresh_cache-4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-a08cd191-2047-4b0d-a9ad-5c2b6b6cf2f8 req-74b37258-8caf-476f-83d4-99e5dcaff819 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a08cd191-2047-4b0d-a9ad-5c2b6b6cf2f8 req-74b37258-8caf-476f-83d4-99e5dcaff819 service nova] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a08cd191-2047-4b0d-a9ad-5c2b6b6cf2f8 req-74b37258-8caf-476f-83d4-99e5dcaff819 service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a08cd191-2047-4b0d-a9ad-5c2b6b6cf2f8 req-74b37258-8caf-476f-83d4-99e5dcaff819 service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-a08cd191-2047-4b0d-a9ad-5c2b6b6cf2f8 req-74b37258-8caf-476f-83d4-99e5dcaff819 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] No waiting events found dispatching network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:57 user nova-compute[75826]: WARNING nova.compute.manager [req-a08cd191-2047-4b0d-a9ad-5c2b6b6cf2f8 req-74b37258-8caf-476f-83d4-99e5dcaff819 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received unexpected event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee for instance with vm_state building and task_state spawning.
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-a08cd191-2047-4b0d-a9ad-5c2b6b6cf2f8 req-74b37258-8caf-476f-83d4-99e5dcaff819 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a08cd191-2047-4b0d-a9ad-5c2b6b6cf2f8 req-74b37258-8caf-476f-83d4-99e5dcaff819 service nova] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a08cd191-2047-4b0d-a9ad-5c2b6b6cf2f8 req-74b37258-8caf-476f-83d4-99e5dcaff819 service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a08cd191-2047-4b0d-a9ad-5c2b6b6cf2f8 req-74b37258-8caf-476f-83d4-99e5dcaff819 service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-a08cd191-2047-4b0d-a9ad-5c2b6b6cf2f8 req-74b37258-8caf-476f-83d4-99e5dcaff819 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] No waiting events found dispatching network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:42:57 user nova-compute[75826]: WARNING nova.compute.manager [req-a08cd191-2047-4b0d-a9ad-5c2b6b6cf2f8 req-74b37258-8caf-476f-83d4-99e5dcaff819 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received unexpected event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee for instance with vm_state building and task_state spawning.
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:42:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Instance spawned successfully.
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:42:57 user nova-compute[75826]: INFO nova.compute.manager [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 16 00:42:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:58 user nova-compute[75826]: INFO nova.compute.manager [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Took 7.88 seconds to build instance.
Nov 16 00:42:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-52fb3fef-9b29-49a7-984e-00cf673b9dc8 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.006s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:42:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:42:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEVTKsux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:42:59 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:42:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:42:59 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:42:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:42:59 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6cbe75-7d61-402f-953d-c10881fc66db]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:42:59 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cc4d9f-05bf-4a99-824f-23307a64279b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18] added
Nov 16 00:42:59 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c96fd8b-26c0-4fe7-87c0-71f19ba6846f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8929ad23-14df-460d-bb7a-fc6d2116b4fe]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEVTKsux {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEVTKsux" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab7dbb9-6471-44b0-b244-a97dcf84bd16]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CEVTKsux'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e574df3-ab1c-435b-b58e-8680cb928edf]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6846ac53-9770-4d9b-90c2-de20177e6ae4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:42:59 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:42:59 user nova-compute[75826]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f (non-flash)
Nov 16 00:42:59 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:42:59 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:42:59 user nova-compute[75826]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f (non-flash)
Nov 16 00:42:59 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:42:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8158ae-b8b7-4021-b77b-900f757130dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260]
Nov 16 00:43:00 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260] successful.
Nov 16 00:43:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:00 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:43:00 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7631MB free_disk=25.67938232421875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f979a7-4367-473b-8442-c0834557a134]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[58003758-0294-46fd-8d12-b5169ca72f94]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:43:00 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:00 user nova-compute[75826]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f (non-flash)
Nov 16 00:43:00 user nova-compute[75826]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:43:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:43:00 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:00 user nova-compute[75826]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f (non-flash)
Nov 16 00:43:00 user nova-compute[75826]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:43:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.830s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a838f1e9-b821-425e-8f8d-81eff0b43a07]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEVTKsux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance d9ac6719-80f7-490a-a51e-869b51118aa2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 33f2b149-1951-44d0-a65a-018316b31712 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 298aaae2-dd4e-412a-8afb-dfaafbd36964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:43:00 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:43:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:43:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.872s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:43:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] <== connect_volume: return (1876ms) {'type': 'block', 'scsi_wwn': '26437323930643766', 'path': '/dev/sdd'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:43:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437323930643766', 'path': '/dev/sdd'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:43:01 user nova-compute[75826]: DEBUG nova.objects.instance [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lazy-loading 'flavor' on Instance uuid 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:43:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:43:01 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:43:01 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 00:43:01 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:43:01 user nova-compute[75826]:   <serial>48b289f4-4b30-4d11-8683-5419d02afa18</serial>
Nov 16 00:43:01 user nova-compute[75826]: </disk>
Nov 16 00:43:01 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:43:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:43:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:43:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:43:02 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:43:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:43:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:43:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] No VIF found with MAC fa:16:3e:be:0d:c1, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:43:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:43:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:43:02 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:43:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b3638418-3146-4863-a12c-5b40f890e6f3 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.171s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:03 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating instance_info_cache with network_info: [{"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:43:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:43:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:43:03 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:43:03 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:43:03 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:43:03 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:43:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:43:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG nova.compute.manager [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Stashing vm_state: active {{(pid=75826) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:43:05 user nova-compute[75826]: INFO nova.compute.claims [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Claim successful on node user
Nov 16 00:43:05 user nova-compute[75826]: INFO nova.compute.resource_tracker [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating resource usage from migration c39a107f-a195-4679-897b-99f03b3e585a
Nov 16 00:43:05 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 is timed out.
Nov 16 00:43:05 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Successfully detached device vdb from instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 from the live domain config.
Nov 16 00:43:05 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xPdjCgiO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:43:05 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ed9994-e154-4f21-b944-83f7efcfc473]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:43:05 user nova-compute[75826]: No targets found.
Nov 16 00:43:05 user nova-compute[75826]: iSNS:
Nov 16 00:43:05 user nova-compute[75826]: No targets found.
Nov 16 00:43:05 user nova-compute[75826]: STATIC:
Nov 16 00:43:05 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:43:05 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:43:05 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:43:05 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f
Nov 16 00:43:05 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:43:05 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:43:05 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632
Nov 16 00:43:05 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:43:05 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:43:05 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:43:05 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:43:05 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:43:05 user nova-compute[75826]: FIRMWARE:
Nov 16 00:43:05 user nova-compute[75826]: No targets found.
Nov 16 00:43:05 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:43:05 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:43:05 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3062169-f7a5-46c1-8f4b-3ba6f73a1ac9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a6528a-0793-4eac-aa6b-145580021038]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:43:05 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:05 user nova-compute[75826]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f (non-flash)
Nov 16 00:43:05 user nova-compute[75826]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:43:05 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:43:05 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:05 user nova-compute[75826]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f (non-flash)
Nov 16 00:43:05 user nova-compute[75826]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:43:05 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd94300dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f'): ({'sdc'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Removing single pathed devices sdc {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[97bc093e-7092-412c-b4b9-a6482d850be9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.534s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:05 user nova-compute[75826]: INFO nova.compute.manager [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Migrating
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:43:05 user nova-compute[75826]: INFO nova.compute.rpcapi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71ea3b4-e764-4e62-9115-a2267d1074d9]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Flushing IO for device /dev/sdc {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acb77a1-6216-4606-a30d-60dce69bc9a7]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquired lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ca6fcc-1c33-482a-a4cc-d94b48b98e1e]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef8d6b3-fcaa-47cf-a763-1c21669a2779]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a90a4ba-047a-4d83-be88-bf08359c987d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f, portal: 172.16.0.220,3260]
Nov 16 00:43:05 user nova-compute[75826]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f, portal: 172.16.0.220,3260] successful.
Nov 16 00:43:05 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dd604f3d-ac35-420a-a0bb-b6b199bce96f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f966c460-f534-4956-995e-7d7ece0a48ee]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] <== disconnect_volume: return (343ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:43:05 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG nova.network.neutron [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating instance_info_cache with network_info: [{"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Releasing lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Starting migrate_disk_and_power_off {{(pid=75826) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG nova.objects.instance [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lazy-loading 'flavor' on Instance uuid 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ae9df36b-c802-40c8-9e47-7e1ce3283f63 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.793s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-155977f3-784e-4eac-bf7d-583e153123ec req-3b298f10-521c-4cda-b2ed-7eb0bd775dba service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-unplugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-155977f3-784e-4eac-bf7d-583e153123ec req-3b298f10-521c-4cda-b2ed-7eb0bd775dba service nova] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-155977f3-784e-4eac-bf7d-583e153123ec req-3b298f10-521c-4cda-b2ed-7eb0bd775dba service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-155977f3-784e-4eac-bf7d-583e153123ec req-3b298f10-521c-4cda-b2ed-7eb0bd775dba service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-155977f3-784e-4eac-bf7d-583e153123ec req-3b298f10-521c-4cda-b2ed-7eb0bd775dba service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] No waiting events found dispatching network-vif-unplugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:43:06 user nova-compute[75826]: WARNING nova.compute.manager [req-155977f3-784e-4eac-bf7d-583e153123ec req-3b298f10-521c-4cda-b2ed-7eb0bd775dba service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received unexpected event network-vif-unplugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc for instance with vm_state active and task_state resize_migrating.
Nov 16 00:43:07 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Instance destroyed successfully.
Nov 16 00:43:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-128052432',display_name='tempest-ServerActionsTestOtherB-server-128052432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-128052432',id=4,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXVSxyrOOv945LMuSP1ZSY2bKy/r2ENoqaOk1WP30X55vRshqh2IlMTn2ZQNXytP2IoxEzIDq41/VjnE1Be/JLQH8UoBKnsMheiLtYOBuEJV23nUuMbFcWJ5C5rYTqIuQ==',key_name='tempest-keypair-103688613',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='150aa3cf14d44a658edb06ade47a2d10',ramdisk_id='',reservation_id='r-tzkzh647',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1007762654',owner_user_name='tempest-ServerActionsTestOtherB-1007762654-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:43:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19886e0e1844467785425d17411f9656',uuid=713e6618-89af-47e0-ba5a-4f77cb1d7ff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-973270379-network", "vif_mac": "fa:16:3e:be:0d:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converting VIF {"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-973270379-network", "vif_mac": "fa:16:3e:be:0d:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_vif [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cb43f66-87, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be8189e2-c676-4ed3-847e-73ece73d2268) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:43:07 user nova-compute[75826]: INFO os_vif [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87')
Nov 16 00:43:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEVTKsux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:43:07 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7920d804-ebdb-417b-a5c3-6e147770b327]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:43:07 user nova-compute[75826]: No targets found.
Nov 16 00:43:07 user nova-compute[75826]: iSNS:
Nov 16 00:43:07 user nova-compute[75826]: No targets found.
Nov 16 00:43:07 user nova-compute[75826]: STATIC:
Nov 16 00:43:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:43:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:43:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:43:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632
Nov 16 00:43:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:43:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:43:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:43:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:43:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:43:07 user nova-compute[75826]: FIRMWARE:
Nov 16 00:43:07 user nova-compute[75826]: No targets found.
Nov 16 00:43:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:43:07 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:43:07 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a981578c-33a0-48c5-95e3-8d3d1e77a633]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acc5cb5-dd87-4dfa-9387-61391710da53]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:43:07 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:07 user nova-compute[75826]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:43:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:43:07 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:07 user nova-compute[75826]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:43:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd944bfc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18'): ({'sdd'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Removing single pathed devices sdd {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4651d1bf-a1ae-45df-b744-dd0348e9611b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe6d4a0-efac-4dbd-8333-c9807cedd1db]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Flushing IO for device /dev/sdd {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88eb33c-750e-48c7-98db-9a60267df9eb]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcce0b6-db3a-41d4-8c7b-1ded8a7b314d]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f38b42e-eb12-468b-92f8-b32c6b035ac7]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[75de9b43-7697-43fd-a167-2d5c7fb3858e]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260]
Nov 16 00:43:07 user nova-compute[75826]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260] successful.
Nov 16 00:43:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e39a3ef-c723-43a1-9844-ea55ac17bc60]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] <== disconnect_volume: return (354ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:43:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6_resize/disk /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CMD "cp -r /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6_resize/disk /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk" returned: 0 in 0.547s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6_resize/disk.info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk.info {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CMD "cp -r /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6_resize/disk.info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk.info" returned: 0 in 0.042s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-09910abc-ee4a-473a-9da6-594a96dc9e8b req-58c67b01-3d7f-4dff-a619-4822ef6ca3cd service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-09910abc-ee4a-473a-9da6-594a96dc9e8b req-58c67b01-3d7f-4dff-a619-4822ef6ca3cd service nova] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-09910abc-ee4a-473a-9da6-594a96dc9e8b req-58c67b01-3d7f-4dff-a619-4822ef6ca3cd service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-09910abc-ee4a-473a-9da6-594a96dc9e8b req-58c67b01-3d7f-4dff-a619-4822ef6ca3cd service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-09910abc-ee4a-473a-9da6-594a96dc9e8b req-58c67b01-3d7f-4dff-a619-4822ef6ca3cd service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] No waiting events found dispatching network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:43:09 user nova-compute[75826]: WARNING nova.compute.manager [req-09910abc-ee4a-473a-9da6-594a96dc9e8b req-58c67b01-3d7f-4dff-a619-4822ef6ca3cd service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received unexpected event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc for instance with vm_state active and task_state resize_migrating.
Nov 16 00:43:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Port 7cb43f66-87cf-4cac-85ab-abfe01ff82cc binding to destination host user is already ACTIVE {{(pid=75826) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 00:43:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:43:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquired lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:43:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG nova.network.neutron [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating instance_info_cache with network_info: [{"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Releasing lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG os_brick.utils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdf9656-1e62-4f0f-96b7-ea50ae9f879f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee1615a-893f-4ee9-a990-b3b74d79dcce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef48ce01-b042-4e6e-a2e8-28dfdf93ba3a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f038021-e482-4ca8-b842-8ff11396ab1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:43:10 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:43:10 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1943894-11ad-4e1b-af75-fd16412af465]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:43:10 user nova-compute[75826]: DEBUG os_brick.utils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:43:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:43:13 user nova-compute[75826]: INFO nova.compute.claims [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Claim successful on node user
Nov 16 00:43:13 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:43:13 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:43:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG nova.policy [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96797fc178ed4c2190f7a760b3bd30bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa522b01f20c4d90bc4178e688319e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:43:13 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Creating image(s)
Nov 16 00:43:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "/opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "/opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "/opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk 1073741824" returned: 0 in 0.051s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.200s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Cannot resize image /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Ensure instance console log exists: /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:14 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Successfully created port: ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "33f2b149-1951-44d0-a65a-018316b31712" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "33f2b149-1951-44d0-a65a-018316b31712" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "33f2b149-1951-44d0-a65a-018316b31712-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:15 user nova-compute[75826]: INFO nova.compute.manager [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Terminating instance
Nov 16 00:43:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Successfully updated port: ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquired lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-c4c530ed-5fcc-45be-a331-c6123ab2589a req-34ae655a-827d-4cb0-8b4b-3c1f96f2379e service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-changed-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-c4c530ed-5fcc-45be-a331-c6123ab2589a req-34ae655a-827d-4cb0-8b4b-3c1f96f2379e service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Refreshing instance network info cache due to event network-changed-ff64782d-047b-4488-80c5-b8866a0c5037. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c4c530ed-5fcc-45be-a331-c6123ab2589a req-34ae655a-827d-4cb0-8b4b-3c1f96f2379e service nova] Acquiring lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-1ab656b7-0597-4cc5-96bf-b68fb43cfa41 req-699ad123-d15e-4420-82a8-94235751cf71 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received event network-vif-unplugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1ab656b7-0597-4cc5-96bf-b68fb43cfa41 req-699ad123-d15e-4420-82a8-94235751cf71 service nova] Acquiring lock "33f2b149-1951-44d0-a65a-018316b31712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1ab656b7-0597-4cc5-96bf-b68fb43cfa41 req-699ad123-d15e-4420-82a8-94235751cf71 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1ab656b7-0597-4cc5-96bf-b68fb43cfa41 req-699ad123-d15e-4420-82a8-94235751cf71 service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-1ab656b7-0597-4cc5-96bf-b68fb43cfa41 req-699ad123-d15e-4420-82a8-94235751cf71 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] No waiting events found dispatching network-vif-unplugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-1ab656b7-0597-4cc5-96bf-b68fb43cfa41 req-699ad123-d15e-4420-82a8-94235751cf71 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received event network-vif-unplugged-a3083677-00f2-46e4-be46-fe34b463d6a4 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Updating instance_info_cache with network_info: [{"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Releasing lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Instance network_info: |[{"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c4c530ed-5fcc-45be-a331-c6123ab2589a req-34ae655a-827d-4cb0-8b4b-3c1f96f2379e service nova] Acquired lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG nova.network.neutron [req-c4c530ed-5fcc-45be-a331-c6123ab2589a req-34ae655a-827d-4cb0-8b4b-3c1f96f2379e service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Refreshing network info cache for port ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:43:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Start _get_guest_xml network_info=[{"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:43:16 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:43:16 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1610404613',display_name='tempest-AttachVolumeTestJSON-server-1610404613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1610404613',id=17,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPd46vcTYm1IGljsZJY5d+bnsYtZu5mDPgxXnccpiKGtfwu7f4jNN4sCNE2xSEkbiGF7AI/QCdZlu654F87C0DsVVQp1j+jeloZ54u8nfEkpLHA8I7BQPi8srBhE2Ey6w==',key_name='tempest-keypair-1910536779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa522b01f20c4d90bc4178e688319e7f',ramdisk_id='',reservation_id='r-tf175bq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1305137356',owner_user_name='tempest-AttachVolumeTestJSON-1305137356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:43:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96797fc178ed4c2190f7a760b3bd30bd',uuid=298c8986-b91b-4f46-bcce-75e28bc02b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converting VIF {"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'pci_devices' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:43:16 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Instance destroyed successfully.
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.objects.instance [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lazy-loading 'resources' on Instance uuid 33f2b149-1951-44d0-a65a-018316b31712 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:43:16 user nova-compute[75826]:   <uuid>298c8986-b91b-4f46-bcce-75e28bc02b5f</uuid>
Nov 16 00:43:16 user nova-compute[75826]:   <name>instance-00000011</name>
Nov 16 00:43:16 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:43:16 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:43:16 user nova-compute[75826]:   <metadata>
Nov 16 00:43:16 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:43:16 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:43:16 user nova-compute[75826]:       <nova:name>tempest-AttachVolumeTestJSON-server-1610404613</nova:name>
Nov 16 00:43:16 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:43:16</nova:creationTime>
Nov 16 00:43:16 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:43:16 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:43:16 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:43:16 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:43:16 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:43:16 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:43:16 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:43:16 user nova-compute[75826]:       <nova:owner>
Nov 16 00:43:16 user nova-compute[75826]:         <nova:user uuid="96797fc178ed4c2190f7a760b3bd30bd">tempest-AttachVolumeTestJSON-1305137356-project-member</nova:user>
Nov 16 00:43:16 user nova-compute[75826]:         <nova:project uuid="aa522b01f20c4d90bc4178e688319e7f">tempest-AttachVolumeTestJSON-1305137356</nova:project>
Nov 16 00:43:16 user nova-compute[75826]:       </nova:owner>
Nov 16 00:43:16 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:43:16 user nova-compute[75826]:       <nova:ports>
Nov 16 00:43:16 user nova-compute[75826]:         <nova:port uuid="ff64782d-047b-4488-80c5-b8866a0c5037">
Nov 16 00:43:16 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 00:43:16 user nova-compute[75826]:         </nova:port>
Nov 16 00:43:16 user nova-compute[75826]:       </nova:ports>
Nov 16 00:43:16 user nova-compute[75826]:     </nova:instance>
Nov 16 00:43:16 user nova-compute[75826]:   </metadata>
Nov 16 00:43:16 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:43:16 user nova-compute[75826]:     <system>
Nov 16 00:43:16 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:43:16 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:43:16 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:43:16 user nova-compute[75826]:       <entry name="serial">298c8986-b91b-4f46-bcce-75e28bc02b5f</entry>
Nov 16 00:43:16 user nova-compute[75826]:       <entry name="uuid">298c8986-b91b-4f46-bcce-75e28bc02b5f</entry>
Nov 16 00:43:16 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:43:16 user nova-compute[75826]:     </system>
Nov 16 00:43:16 user nova-compute[75826]:   </sysinfo>
Nov 16 00:43:16 user nova-compute[75826]:   <os>
Nov 16 00:43:16 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:43:16 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:43:16 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:43:16 user nova-compute[75826]:   </os>
Nov 16 00:43:16 user nova-compute[75826]:   <features>
Nov 16 00:43:16 user nova-compute[75826]:     <acpi/>
Nov 16 00:43:16 user nova-compute[75826]:     <apic/>
Nov 16 00:43:16 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:43:16 user nova-compute[75826]:   </features>
Nov 16 00:43:16 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:43:16 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:43:16 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:43:16 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:43:16 user nova-compute[75826]:   </clock>
Nov 16 00:43:16 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:43:16 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:43:16 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:43:16 user nova-compute[75826]:   </cpu>
Nov 16 00:43:16 user nova-compute[75826]:   <devices>
Nov 16 00:43:16 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:43:16 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:43:16 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk"/>
Nov 16 00:43:16 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:43:16 user nova-compute[75826]:     </disk>
Nov 16 00:43:16 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:43:16 user nova-compute[75826]:       <mac address="fa:16:3e:fc:58:e0"/>
Nov 16 00:43:16 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:43:16 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:43:16 user nova-compute[75826]:       <target dev="tapff64782d-04"/>
Nov 16 00:43:16 user nova-compute[75826]:     </interface>
Nov 16 00:43:16 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:43:16 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/console.log" append="off"/>
Nov 16 00:43:16 user nova-compute[75826]:     </serial>
Nov 16 00:43:16 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:43:16 user nova-compute[75826]:     <video>
Nov 16 00:43:16 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:43:16 user nova-compute[75826]:     </video>
Nov 16 00:43:16 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:43:16 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:43:16 user nova-compute[75826]:     </rng>
Nov 16 00:43:16 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:43:16 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:43:16 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:43:16 user nova-compute[75826]:     </memballoon>
Nov 16 00:43:16 user nova-compute[75826]:   </devices>
Nov 16 00:43:16 user nova-compute[75826]: </domain>
Nov 16 00:43:16 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1610404613',display_name='tempest-AttachVolumeTestJSON-server-1610404613',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1610404613',id=17,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPd46vcTYm1IGljsZJY5d+bnsYtZu5mDPgxXnccpiKGtfwu7f4jNN4sCNE2xSEkbiGF7AI/QCdZlu654F87C0DsVVQp1j+jeloZ54u8nfEkpLHA8I7BQPi8srBhE2Ey6w==',key_name='tempest-keypair-1910536779',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa522b01f20c4d90bc4178e688319e7f',ramdisk_id='',reservation_id='r-tf175bq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1305137356',owner_user_name='tempest-AttachVolumeTestJSON-1305137356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:43:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96797fc178ed4c2190f7a760b3bd30bd',uuid=298c8986-b91b-4f46-bcce-75e28bc02b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converting VIF {"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_vif [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87081e3d-e6cc-58df-8179-db816c643a62', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T00:39:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-282460160',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1379364694',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPCXS8mfCk4vTQ8KvD02SkTq5b8gadS3Dv2Lo+h6cewehr3vqpTDQTQHj0qaShguaufSxu99avO/2zXpxPkqDPHOswK5I94kwnDiKdL++s2lPV/rz6rgG0dXcQu0zhVySw==',key_name='tempest-keypair-1471744927',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:41:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7b28d760459a430b9116e57172e64a77',ramdisk_id='',reservation_id='r-qvs9it1p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1015349843',owner_user_name='tempest-ServerActionsV293TestJSON-1015349843-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:41:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d44daf19202c4460a56205d614f05118',uuid=33f2b149-1951-44d0-a65a-018316b31712,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Converting VIF {"id": "a3083677-00f2-46e4-be46-fe34b463d6a4", "address": "fa:16:3e:e2:5d:c2", "network": {"id": "a9dbb151-ae01-4717-a7b6-655a1ad7c309", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-235239172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.7", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7b28d760459a430b9116e57172e64a77", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3083677-00", "ovs_interfaceid": "a3083677-00f2-46e4-be46-fe34b463d6a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_vif [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3083677-00, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff64782d-04, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff64782d-04, col_values=(('qos', UUID('ad9b5211-d3bc-46ca-8e77-62244bebeef3')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff64782d-04, col_values=(('external_ids', {'iface-id': 'ff64782d-047b-4488-80c5-b8866a0c5037', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:58:e0', 'vm-uuid': '298c8986-b91b-4f46-bcce-75e28bc02b5f'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:16 user nova-compute[75826]: INFO os_vif [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04')
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a22f5ce-22c3-4fe5-b95f-e70eeecfee53) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:16 user nova-compute[75826]: INFO os_vif [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:5d:c2,bridge_name='br-int',has_traffic_filtering=True,id=a3083677-00f2-46e4-be46-fe34b463d6a4,network=Network(a9dbb151-ae01-4717-a7b6-655a1ad7c309),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3083677-00')
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xbUymzfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:43:16 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[906155fb-850d-43d3-b82c-12fedcffdb9a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:43:16 user nova-compute[75826]: No targets found.
Nov 16 00:43:16 user nova-compute[75826]: iSNS:
Nov 16 00:43:16 user nova-compute[75826]: No targets found.
Nov 16 00:43:16 user nova-compute[75826]: STATIC:
Nov 16 00:43:16 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632
Nov 16 00:43:16 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:43:16 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:43:16 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:43:16 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:43:16 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:43:16 user nova-compute[75826]: FIRMWARE:
Nov 16 00:43:16 user nova-compute[75826]: No targets found.
Nov 16 00:43:16 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:43:16 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:43:16 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No VIF found with MAC fa:16:3e:fc:58:e0, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c1498c-153a-48f0-9309-d8c11a7061ab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bd4257-9a79-45b3-9255-46cfa2eb415e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:43:16 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:16 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 (non-flash)
Nov 16 00:43:16 user nova-compute[75826]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:16 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb4253ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632'): ({'sdf'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Removing single pathed devices sdf {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e8405f-61da-41d1-a288-407cbbc8cb91]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd46b27-c9c8-4b4e-b78e-34742213e771]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Flushing IO for device /dev/sdf {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[99129bab-48c6-4359-b3fb-75757d367958]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ba3372-1e38-4dc8-9903-49a63ef397b0]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23338393733663037', '/dev/disk/by-id/scsi-1SCST_BIO5f8345e8-38973f07e38085c8', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5f8345e8') {{(pid=85991) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcdd4a94-2650-4c82-8193-447895a7f636]: (4, None) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaca6eca-7332-468d-886e-64e4b879f2b5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.network.neutron [req-c4c530ed-5fcc-45be-a331-c6123ab2589a req-34ae655a-827d-4cb0-8b4b-3c1f96f2379e service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Updated VIF entry in instance network info cache for port ff64782d-047b-4488-80c5-b8866a0c5037. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.network.neutron [req-c4c530ed-5fcc-45be-a331-c6123ab2589a req-34ae655a-827d-4cb0-8b4b-3c1f96f2379e service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Updating instance_info_cache with network_info: [{"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[91773cec-b358-4af9-bbea-b96de5bf4694]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260]
Nov 16 00:43:16 user nova-compute[75826]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632, portal: 172.16.0.220,3260] successful.
Nov 16 00:43:16 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c4c530ed-5fcc-45be-a331-c6123ab2589a req-34ae655a-827d-4cb0-8b4b-3c1f96f2379e service nova] Releasing lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef9dbcbd-3c51-40de-bfc8-4519b8543632 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae132cdd-8766-4041-9647-41563d2f17d9]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] <== disconnect_volume: return (320ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:43:16 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Deleting instance files /opt/stack/data/nova/instances/33f2b149-1951-44d0-a65a-018316b31712_del
Nov 16 00:43:16 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Deletion of /opt/stack/data/nova/instances/33f2b149-1951-44d0-a65a-018316b31712_del complete
Nov 16 00:43:16 user nova-compute[75826]: INFO nova.compute.manager [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Took 1.24 seconds to destroy the instance on the hypervisor.
Nov 16 00:43:16 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:43:16 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 33f2b149-1951-44d0-a65a-018316b31712] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Starting finish_migration {{(pid=75826) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Instance directory exists: not creating {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 00:43:17 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Creating image(s)
Nov 16 00:43:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:17 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Took 0.94 seconds to deallocate network for instance.
Nov 16 00:43:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Checking if we can resize image /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk. size=21474836480 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-9a9856ae-ba18-4911-8aa3-c236abbafcca req-449da65c-2f9e-4b8b-9598-861bce01c024 service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received event network-vif-deleted-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-2c566f8b-947d-42d9-9b22-4e9c62f1c0e6 req-02543180-dd65-4535-bf9b-a4ccbe633eca service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received event network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2c566f8b-947d-42d9-9b22-4e9c62f1c0e6 req-02543180-dd65-4535-bf9b-a4ccbe633eca service nova] Acquiring lock "33f2b149-1951-44d0-a65a-018316b31712-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2c566f8b-947d-42d9-9b22-4e9c62f1c0e6 req-02543180-dd65-4535-bf9b-a4ccbe633eca service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2c566f8b-947d-42d9-9b22-4e9c62f1c0e6 req-02543180-dd65-4535-bf9b-a4ccbe633eca service nova] Lock "33f2b149-1951-44d0-a65a-018316b31712-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-2c566f8b-947d-42d9-9b22-4e9c62f1c0e6 req-02543180-dd65-4535-bf9b-a4ccbe633eca service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] No waiting events found dispatching network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:43:17 user nova-compute[75826]: WARNING nova.compute.manager [req-2c566f8b-947d-42d9-9b22-4e9c62f1c0e6 req-02543180-dd65-4535-bf9b-a4ccbe633eca service nova] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Received unexpected event network-vif-plugged-a3083677-00f2-46e4-be46-fe34b463d6a4 for instance with vm_state active and task_state deleting.
Nov 16 00:43:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk 21474836480 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk 21474836480" returned: 0 in 0.048s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Ensure instance console log exists: /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Start _get_guest_xml network_info=[{"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-973270379-network", "vif_mac": "fa:16:3e:be:0d:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '33612448-6323-467e-92c7-3d91efcc53d5', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEVTKsux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '713e6618-89af-47e0-ba5a-4f77cb1d7ff6', 'attached_at': '2023-11-16T00:43:17.000000', 'detached_at': '', 'volume_id': '48b289f4-4b30-4d11-8683-5419d02afa18', 'serial': '48b289f4-4b30-4d11-8683-5419d02afa18'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:43:17 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:43:17 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:43:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEVTKsux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:43:17 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:43:17 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:43:18 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:43:18 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d651128f-dc3a-4114-866f-363bd47ed97f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:43:18 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46d8b5e-7481-4441-823d-f6144a3d2966]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18] added
Nov 16 00:43:18 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62ffaf3-d56d-4144-84ab-ee7229faed07]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a66fb5a-7fdd-4240-9794-9e7d126e966f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEVTKsux {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEVTKsux" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a832201-bdeb-4d99-a484-a32fadd283f6]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CEVTKsux'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9db8b2c-ce22-4b4c-abe0-728abca5cd2f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2258a8-6c17-46d3-9cbf-a670a87339f1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:18 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:18 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf6438f-45c8-4eb3-90b7-a3448aa9bdeb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260]
Nov 16 00:43:18 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260] successful.
Nov 16 00:43:18 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[62918351-0d3a-471a-9ef6-1089050b27e9]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce40a5e8-4e26-4696-947a-4bb7cba86dd2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:18 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:43:18 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:18 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:43:18 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86fdb98-8694-4b31-a7c8-3f84fa9cc286]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEVTKsux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:43:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26437323930643766', 'path': '/dev/sdc'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437323930643766', 'path': '/dev/sdc'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-128052432',display_name='tempest-ServerActionsTestOtherB-server-128052432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-128052432',id=4,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXVSxyrOOv945LMuSP1ZSY2bKy/r2ENoqaOk1WP30X55vRshqh2IlMTn2ZQNXytP2IoxEzIDq41/VjnE1Be/JLQH8UoBKnsMheiLtYOBuEJV23nUuMbFcWJ5C5rYTqIuQ==',key_name='tempest-keypair-103688613',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='150aa3cf14d44a658edb06ade47a2d10',ramdisk_id='',reservation_id='r-tzkzh647',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1007762654',owner_user_name='tempest-ServerActionsTestOtherB-1007762654-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:43:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19886e0e1844467785425d17411f9656',uuid=713e6618-89af-47e0-ba5a-4f77cb1d7ff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-973270379-network", "vif_mac": "fa:16:3e:be:0d:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converting VIF {"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-973270379-network", "vif_mac": "fa:16:3e:be:0d:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:43:19 user nova-compute[75826]:   <uuid>713e6618-89af-47e0-ba5a-4f77cb1d7ff6</uuid>
Nov 16 00:43:19 user nova-compute[75826]:   <name>instance-00000004</name>
Nov 16 00:43:19 user nova-compute[75826]:   <memory>2097152</memory>
Nov 16 00:43:19 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:43:19 user nova-compute[75826]:   <metadata>
Nov 16 00:43:19 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:43:19 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:43:19 user nova-compute[75826]:       <nova:name>tempest-ServerActionsTestOtherB-server-128052432</nova:name>
Nov 16 00:43:19 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:43:17</nova:creationTime>
Nov 16 00:43:19 user nova-compute[75826]:       <nova:flavor name="m1.small">
Nov 16 00:43:19 user nova-compute[75826]:         <nova:memory>2048</nova:memory>
Nov 16 00:43:19 user nova-compute[75826]:         <nova:disk>20</nova:disk>
Nov 16 00:43:19 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:43:19 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:43:19 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:43:19 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:43:19 user nova-compute[75826]:       <nova:owner>
Nov 16 00:43:19 user nova-compute[75826]:         <nova:user uuid="19886e0e1844467785425d17411f9656">tempest-ServerActionsTestOtherB-1007762654-project-member</nova:user>
Nov 16 00:43:19 user nova-compute[75826]:         <nova:project uuid="150aa3cf14d44a658edb06ade47a2d10">tempest-ServerActionsTestOtherB-1007762654</nova:project>
Nov 16 00:43:19 user nova-compute[75826]:       </nova:owner>
Nov 16 00:43:19 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:43:19 user nova-compute[75826]:       <nova:ports>
Nov 16 00:43:19 user nova-compute[75826]:         <nova:port uuid="7cb43f66-87cf-4cac-85ab-abfe01ff82cc">
Nov 16 00:43:19 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 00:43:19 user nova-compute[75826]:         </nova:port>
Nov 16 00:43:19 user nova-compute[75826]:       </nova:ports>
Nov 16 00:43:19 user nova-compute[75826]:     </nova:instance>
Nov 16 00:43:19 user nova-compute[75826]:   </metadata>
Nov 16 00:43:19 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:43:19 user nova-compute[75826]:     <system>
Nov 16 00:43:19 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:43:19 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:43:19 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:43:19 user nova-compute[75826]:       <entry name="serial">713e6618-89af-47e0-ba5a-4f77cb1d7ff6</entry>
Nov 16 00:43:19 user nova-compute[75826]:       <entry name="uuid">713e6618-89af-47e0-ba5a-4f77cb1d7ff6</entry>
Nov 16 00:43:19 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:43:19 user nova-compute[75826]:     </system>
Nov 16 00:43:19 user nova-compute[75826]:   </sysinfo>
Nov 16 00:43:19 user nova-compute[75826]:   <os>
Nov 16 00:43:19 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:43:19 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:43:19 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:43:19 user nova-compute[75826]:   </os>
Nov 16 00:43:19 user nova-compute[75826]:   <features>
Nov 16 00:43:19 user nova-compute[75826]:     <acpi/>
Nov 16 00:43:19 user nova-compute[75826]:     <apic/>
Nov 16 00:43:19 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:43:19 user nova-compute[75826]:   </features>
Nov 16 00:43:19 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:43:19 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:43:19 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:43:19 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:43:19 user nova-compute[75826]:   </clock>
Nov 16 00:43:19 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:43:19 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:43:19 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:43:19 user nova-compute[75826]:   </cpu>
Nov 16 00:43:19 user nova-compute[75826]:   <devices>
Nov 16 00:43:19 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:43:19 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:43:19 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk"/>
Nov 16 00:43:19 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:43:19 user nova-compute[75826]:     </disk>
Nov 16 00:43:19 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:43:19 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:43:19 user nova-compute[75826]:       <source dev="/dev/sdc"/>
Nov 16 00:43:19 user nova-compute[75826]:       <target dev="vdb" bus="virtio"/>
Nov 16 00:43:19 user nova-compute[75826]:       <serial>48b289f4-4b30-4d11-8683-5419d02afa18</serial>
Nov 16 00:43:19 user nova-compute[75826]:     </disk>
Nov 16 00:43:19 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:43:19 user nova-compute[75826]:       <mac address="fa:16:3e:be:0d:c1"/>
Nov 16 00:43:19 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:43:19 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:43:19 user nova-compute[75826]:       <target dev="tap7cb43f66-87"/>
Nov 16 00:43:19 user nova-compute[75826]:     </interface>
Nov 16 00:43:19 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:43:19 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/console.log" append="off"/>
Nov 16 00:43:19 user nova-compute[75826]:     </serial>
Nov 16 00:43:19 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:43:19 user nova-compute[75826]:     <video>
Nov 16 00:43:19 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:43:19 user nova-compute[75826]:     </video>
Nov 16 00:43:19 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:43:19 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:43:19 user nova-compute[75826]:     </rng>
Nov 16 00:43:19 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:43:19 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:43:19 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:43:19 user nova-compute[75826]:     </memballoon>
Nov 16 00:43:19 user nova-compute[75826]:   </devices>
Nov 16 00:43:19 user nova-compute[75826]: </domain>
Nov 16 00:43:19 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-128052432',display_name='tempest-ServerActionsTestOtherB-server-128052432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-128052432',id=4,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXVSxyrOOv945LMuSP1ZSY2bKy/r2ENoqaOk1WP30X55vRshqh2IlMTn2ZQNXytP2IoxEzIDq41/VjnE1Be/JLQH8UoBKnsMheiLtYOBuEJV23nUuMbFcWJ5C5rYTqIuQ==',key_name='tempest-keypair-103688613',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='150aa3cf14d44a658edb06ade47a2d10',ramdisk_id='',reservation_id='r-tzkzh647',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1007762654',owner_user_name='tempest-ServerActionsTestOtherB-1007762654-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:43:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19886e0e1844467785425d17411f9656',uuid=713e6618-89af-47e0-ba5a-4f77cb1d7ff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-973270379-network", "vif_mac": "fa:16:3e:be:0d:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converting VIF {"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-973270379-network", "vif_mac": "fa:16:3e:be:0d:c1"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG os_vif [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5a7e6b6-f748-50cf-90d8-48efb2e56403', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cb43f66-87, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cb43f66-87, col_values=(('qos', UUID('a57111fd-9450-4e0d-9c56-932d86d9a8ee')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cb43f66-87, col_values=(('external_ids', {'iface-id': '7cb43f66-87cf-4cac-85ab-abfe01ff82cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:0d:c1', 'vm-uuid': '713e6618-89af-47e0-ba5a-4f77cb1d7ff6'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:19 user nova-compute[75826]: INFO os_vif [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87')
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] No VIF found with MAC fa:16:3e:be:0d:c1, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.compute.manager [req-c4be07e4-efb7-401f-bc64-beea657fc3c3 req-27e52278-021e-4632-8646-5be09d56511e service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c4be07e4-efb7-401f-bc64-beea657fc3c3 req-27e52278-021e-4632-8646-5be09d56511e service nova] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c4be07e4-efb7-401f-bc64-beea657fc3c3 req-27e52278-021e-4632-8646-5be09d56511e service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c4be07e4-efb7-401f-bc64-beea657fc3c3 req-27e52278-021e-4632-8646-5be09d56511e service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.compute.manager [req-c4be07e4-efb7-401f-bc64-beea657fc3c3 req-27e52278-021e-4632-8646-5be09d56511e service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] No waiting events found dispatching network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:43:19 user nova-compute[75826]: WARNING nova.compute.manager [req-c4be07e4-efb7-401f-bc64-beea657fc3c3 req-27e52278-021e-4632-8646-5be09d56511e service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received unexpected event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 for instance with vm_state building and task_state spawning.
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.compute.manager [req-c4be07e4-efb7-401f-bc64-beea657fc3c3 req-27e52278-021e-4632-8646-5be09d56511e service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c4be07e4-efb7-401f-bc64-beea657fc3c3 req-27e52278-021e-4632-8646-5be09d56511e service nova] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c4be07e4-efb7-401f-bc64-beea657fc3c3 req-27e52278-021e-4632-8646-5be09d56511e service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c4be07e4-efb7-401f-bc64-beea657fc3c3 req-27e52278-021e-4632-8646-5be09d56511e service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.compute.manager [req-c4be07e4-efb7-401f-bc64-beea657fc3c3 req-27e52278-021e-4632-8646-5be09d56511e service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] No waiting events found dispatching network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:43:19 user nova-compute[75826]: WARNING nova.compute.manager [req-c4be07e4-efb7-401f-bc64-beea657fc3c3 req-27e52278-021e-4632-8646-5be09d56511e service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received unexpected event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 for instance with vm_state building and task_state spawning.
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:43:19 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Instance spawned successfully.
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:43:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:43:20 user nova-compute[75826]: INFO nova.compute.manager [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Took 6.16 seconds to spawn the instance on the hypervisor.
Nov 16 00:43:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:43:20 user nova-compute[75826]: INFO nova.compute.manager [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Took 6.98 seconds to build instance.
Nov 16 00:43:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d84d6c9a-57d0-4eab-a8af-d068be1ed9a1 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.071s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:20 user nova-compute[75826]: INFO nova.compute.manager [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Took 2.85 seconds to detach 1 volumes for instance.
Nov 16 00:43:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] [instance: 33f2b149-1951-44d0-a65a-018316b31712] Deleting volume: ef9dbcbd-3c51-40de-bfc8-4519b8543632 {{(pid=75826) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 00:43:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:20 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:43:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:20 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:43:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.520s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:21 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Deleted allocations for instance 33f2b149-1951-44d0-a65a-018316b31712
Nov 16 00:43:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8d956139-d0f2-47bf-a444-d1288fb2c26f tempest-ServerActionsV293TestJSON-1015349843 tempest-ServerActionsV293TestJSON-1015349843-project-member] Lock "33f2b149-1951-44d0-a65a-018316b31712" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.916s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-7892c664-a673-4c45-ab7a-f513c01c63a3 req-a667f983-37de-4fe8-bbd2-998a55130147 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7892c664-a673-4c45-ab7a-f513c01c63a3 req-a667f983-37de-4fe8-bbd2-998a55130147 service nova] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7892c664-a673-4c45-ab7a-f513c01c63a3 req-a667f983-37de-4fe8-bbd2-998a55130147 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7892c664-a673-4c45-ab7a-f513c01c63a3 req-a667f983-37de-4fe8-bbd2-998a55130147 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-7892c664-a673-4c45-ab7a-f513c01c63a3 req-a667f983-37de-4fe8-bbd2-998a55130147 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] No waiting events found dispatching network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:43:21 user nova-compute[75826]: WARNING nova.compute.manager [req-7892c664-a673-4c45-ab7a-f513c01c63a3 req-a667f983-37de-4fe8-bbd2-998a55130147 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received unexpected event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc for instance with vm_state active and task_state resize_finish.
Nov 16 00:43:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-46821253-6099-4ced-aa17-b21df462ba91 req-7b4c1f6b-3959-4085-b0ae-5ccb9ca52cc2 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-46821253-6099-4ced-aa17-b21df462ba91 req-7b4c1f6b-3959-4085-b0ae-5ccb9ca52cc2 service nova] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-46821253-6099-4ced-aa17-b21df462ba91 req-7b4c1f6b-3959-4085-b0ae-5ccb9ca52cc2 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-46821253-6099-4ced-aa17-b21df462ba91 req-7b4c1f6b-3959-4085-b0ae-5ccb9ca52cc2 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-46821253-6099-4ced-aa17-b21df462ba91 req-7b4c1f6b-3959-4085-b0ae-5ccb9ca52cc2 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] No waiting events found dispatching network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:43:23 user nova-compute[75826]: WARNING nova.compute.manager [req-46821253-6099-4ced-aa17-b21df462ba91 req-7b4c1f6b-3959-4085-b0ae-5ccb9ca52cc2 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received unexpected event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc for instance with vm_state active and task_state resize_finish.
Nov 16 00:43:23 user nova-compute[75826]: DEBUG nova.compute.manager [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:43:23 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Instance running successfully.
Nov 16 00:43:23 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Failed to set time: agent not configured {{(pid=75826) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 00:43:23 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-beff8c20-d82f-4fd8-a97a-b8f494e276d4 tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] finish_migration finished successfully. {{(pid=75826) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 00:43:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:43:39 user nova-compute[75826]: INFO nova.compute.manager [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] instance snapshotting
Nov 16 00:43:39 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Beginning live snapshot process
Nov 16 00:43:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json -f qcow2 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json -f qcow2 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json -f qcow2" returned: 0 in 0.194s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl66bl4g0/557f0c0159f34beb9e672f80dcb97a02.delta 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpl66bl4g0/557f0c0159f34beb9e672f80dcb97a02.delta 1073741824" returned: 0 in 0.055s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:40 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 00:43:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:43:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:43:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 00:43:42 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:43:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl66bl4g0/557f0c0159f34beb9e672f80dcb97a02.delta /opt/stack/data/nova/instances/snapshots/tmpl66bl4g0/557f0c0159f34beb9e672f80dcb97a02 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpl66bl4g0/557f0c0159f34beb9e672f80dcb97a02.delta /opt/stack/data/nova/instances/snapshots/tmpl66bl4g0/557f0c0159f34beb9e672f80dcb97a02" returned: 0 in 0.609s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Snapshot extracted, beginning image upload
Nov 16 00:43:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:46 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Snapshot image upload complete
Nov 16 00:43:46 user nova-compute[75826]: INFO nova.compute.manager [None req-27d50a2a-6ecf-459c-abf7-b208947dca0f tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Took 6.99 seconds to snapshot the instance on the hypervisor.
Nov 16 00:43:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:49 user nova-compute[75826]: DEBUG nova.compute.manager [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:43:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:49 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:43:49 user nova-compute[75826]: INFO nova.compute.claims [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Claim successful on node user
Nov 16 00:43:50 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:43:50 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:43:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.647s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:43:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:43:50 user nova-compute[75826]: DEBUG nova.network.neutron [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:43:50 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:43:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:43:50 user nova-compute[75826]: DEBUG nova.policy [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5562a4fee0d14187bcb346ba5a4634af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '151c8475c39a472b9f99d7b94752e148', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:43:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:43:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:43:50 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Creating image(s)
Nov 16 00:43:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "/opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "/opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "/opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "db05b037fd11181b9c08ff338a02636988b7c7b9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "db05b037fd11181b9c08ff338a02636988b7c7b9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9.part --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9.part --force-share --output=json" returned: 0 in 0.195s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:51 user nova-compute[75826]: DEBUG nova.virt.images [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] 182a3508-62d9-4ea2-ad79-8a25af60da10 was qcow2, converting to raw {{(pid=75826) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 00:43:51 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:43:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9.part /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9.converted {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9.part /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9.converted" returned: 0 in 0.329s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9.converted --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9.converted --force-share --output=json" returned: 0 in 0.198s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "db05b037fd11181b9c08ff338a02636988b7c7b9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.570s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9 --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9 --force-share --output=json" returned: 0 in 0.194s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "db05b037fd11181b9c08ff338a02636988b7c7b9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "db05b037fd11181b9c08ff338a02636988b7c7b9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9 --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG nova.network.neutron [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Successfully created port: 9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9 --force-share --output=json" returned: 0 in 0.192s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9,backing_fmt=raw /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9,backing_fmt=raw /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk 1073741824" returned: 0 in 0.072s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "db05b037fd11181b9c08ff338a02636988b7c7b9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9 --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9 --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Ensure instance console log exists: /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Successfully updated port: 9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "refresh_cache-eeb0e320-431c-44ad-bbb9-3eda75234ed1" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquired lock "refresh_cache-eeb0e320-431c-44ad-bbb9-3eda75234ed1" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-f117ca3b-da51-40fb-9543-08cfa2e0c9ad req-ec73beb4-bfee-46ba-8579-78fd44b60829 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Received event network-changed-9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-f117ca3b-da51-40fb-9543-08cfa2e0c9ad req-ec73beb4-bfee-46ba-8579-78fd44b60829 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Refreshing instance network info cache due to event network-changed-9eca4e57-6005-41bb-b05b-3fb5793ffc88. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f117ca3b-da51-40fb-9543-08cfa2e0c9ad req-ec73beb4-bfee-46ba-8579-78fd44b60829 service nova] Acquiring lock "refresh_cache-eeb0e320-431c-44ad-bbb9-3eda75234ed1" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:43:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:54 user nova-compute[75826]: INFO nova.compute.manager [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Rescuing
Nov 16 00:43:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquired lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.network.neutron [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.network.neutron [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Updating instance_info_cache with network_info: [{"id": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "address": "fa:16:3e:a9:78:21", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4e57-60", "ovs_interfaceid": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Releasing lock "refresh_cache-eeb0e320-431c-44ad-bbb9-3eda75234ed1" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Instance network_info: |[{"id": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "address": "fa:16:3e:a9:78:21", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4e57-60", "ovs_interfaceid": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f117ca3b-da51-40fb-9543-08cfa2e0c9ad req-ec73beb4-bfee-46ba-8579-78fd44b60829 service nova] Acquired lock "refresh_cache-eeb0e320-431c-44ad-bbb9-3eda75234ed1" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.network.neutron [req-f117ca3b-da51-40fb-9543-08cfa2e0c9ad req-ec73beb4-bfee-46ba-8579-78fd44b60829 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Refreshing network info cache for port 9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Start _get_guest_xml network_info=[{"id": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "address": "fa:16:3e:a9:78:21", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4e57-60", "ovs_interfaceid": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='0d29ea8580900286f97150a129547cac',container_format='bare',created_at=2023-11-16T00:43:39Z,direct_url=<?>,disk_format='qcow2',id=182a3508-62d9-4ea2-ad79-8a25af60da10,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1321250103',owner='151c8475c39a472b9f99d7b94752e148',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T00:43:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '182a3508-62d9-4ea2-ad79-8a25af60da10'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:43:54 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:43:54 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0d29ea8580900286f97150a129547cac',container_format='bare',created_at=2023-11-16T00:43:39Z,direct_url=<?>,disk_format='qcow2',id=182a3508-62d9-4ea2-ad79-8a25af60da10,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1321250103',owner='151c8475c39a472b9f99d7b94752e148',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T00:43:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-917628068',display_name='tempest-TestStampPattern-server-917628068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-917628068',id=18,image_ref='182a3508-62d9-4ea2-ad79-8a25af60da10',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnVOKXX9r1n1SeXR18FAZ5ReiXMg6r0YfIpLL5KrVybqfFaIfm7SGvy2MKiB0irAegI0W1yk67LwVXLx0F4yvrQoFAmD1fY1rcoS5KnlcevqtmC0fE4TYt7AS0e05sCcw==',key_name='tempest-TestStampPattern-2032325257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='151c8475c39a472b9f99d7b94752e148',ramdisk_id='',reservation_id='r-gsd162wh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25',image_min_disk='1',image_min_ram='0',image_owner_id='151c8475c39a472b9f99d7b94752e148',image_owner_project_name='tempest-TestStampPattern-1037297845',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1037297845-project-member',image_user_id='5562a4fee0d14187bcb346ba5a4634af',network_allocated='True',owner_project_name='tempest-TestStampPattern-1037297845',owner_user_name='tempest-TestStampPattern-1037297845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:43:51Z,user_data=None,user_id='5562a4fee0d14187bcb346ba5a4634af',uuid=eeb0e320-431c-44ad-bbb9-3eda75234ed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "address": "fa:16:3e:a9:78:21", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4e57-60", "ovs_interfaceid": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Converting VIF {"id": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "address": "fa:16:3e:a9:78:21", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4e57-60", "ovs_interfaceid": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:78:21,bridge_name='br-int',has_traffic_filtering=True,id=9eca4e57-6005-41bb-b05b-3fb5793ffc88,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4e57-60') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.objects.instance [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lazy-loading 'pci_devices' on Instance uuid eeb0e320-431c-44ad-bbb9-3eda75234ed1 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:43:54 user nova-compute[75826]:   <uuid>eeb0e320-431c-44ad-bbb9-3eda75234ed1</uuid>
Nov 16 00:43:54 user nova-compute[75826]:   <name>instance-00000012</name>
Nov 16 00:43:54 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:43:54 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:43:54 user nova-compute[75826]:   <metadata>
Nov 16 00:43:54 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:43:54 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:43:54 user nova-compute[75826]:       <nova:name>tempest-TestStampPattern-server-917628068</nova:name>
Nov 16 00:43:54 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:43:54</nova:creationTime>
Nov 16 00:43:54 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:43:54 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:43:54 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:43:54 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:43:54 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:43:54 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:43:54 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:43:54 user nova-compute[75826]:       <nova:owner>
Nov 16 00:43:54 user nova-compute[75826]:         <nova:user uuid="5562a4fee0d14187bcb346ba5a4634af">tempest-TestStampPattern-1037297845-project-member</nova:user>
Nov 16 00:43:54 user nova-compute[75826]:         <nova:project uuid="151c8475c39a472b9f99d7b94752e148">tempest-TestStampPattern-1037297845</nova:project>
Nov 16 00:43:54 user nova-compute[75826]:       </nova:owner>
Nov 16 00:43:54 user nova-compute[75826]:       <nova:root type="image" uuid="182a3508-62d9-4ea2-ad79-8a25af60da10"/>
Nov 16 00:43:54 user nova-compute[75826]:       <nova:ports>
Nov 16 00:43:54 user nova-compute[75826]:         <nova:port uuid="9eca4e57-6005-41bb-b05b-3fb5793ffc88">
Nov 16 00:43:54 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 00:43:54 user nova-compute[75826]:         </nova:port>
Nov 16 00:43:54 user nova-compute[75826]:       </nova:ports>
Nov 16 00:43:54 user nova-compute[75826]:     </nova:instance>
Nov 16 00:43:54 user nova-compute[75826]:   </metadata>
Nov 16 00:43:54 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:43:54 user nova-compute[75826]:     <system>
Nov 16 00:43:54 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:43:54 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:43:54 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:43:54 user nova-compute[75826]:       <entry name="serial">eeb0e320-431c-44ad-bbb9-3eda75234ed1</entry>
Nov 16 00:43:54 user nova-compute[75826]:       <entry name="uuid">eeb0e320-431c-44ad-bbb9-3eda75234ed1</entry>
Nov 16 00:43:54 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:43:54 user nova-compute[75826]:     </system>
Nov 16 00:43:54 user nova-compute[75826]:   </sysinfo>
Nov 16 00:43:54 user nova-compute[75826]:   <os>
Nov 16 00:43:54 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:43:54 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:43:54 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:43:54 user nova-compute[75826]:   </os>
Nov 16 00:43:54 user nova-compute[75826]:   <features>
Nov 16 00:43:54 user nova-compute[75826]:     <acpi/>
Nov 16 00:43:54 user nova-compute[75826]:     <apic/>
Nov 16 00:43:54 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:43:54 user nova-compute[75826]:   </features>
Nov 16 00:43:54 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:43:54 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:43:54 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:43:54 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:43:54 user nova-compute[75826]:   </clock>
Nov 16 00:43:54 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:43:54 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:43:54 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:43:54 user nova-compute[75826]:   </cpu>
Nov 16 00:43:54 user nova-compute[75826]:   <devices>
Nov 16 00:43:54 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:43:54 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:43:54 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk"/>
Nov 16 00:43:54 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:43:54 user nova-compute[75826]:     </disk>
Nov 16 00:43:54 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:43:54 user nova-compute[75826]:       <mac address="fa:16:3e:a9:78:21"/>
Nov 16 00:43:54 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:43:54 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:43:54 user nova-compute[75826]:       <target dev="tap9eca4e57-60"/>
Nov 16 00:43:54 user nova-compute[75826]:     </interface>
Nov 16 00:43:54 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:43:54 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/console.log" append="off"/>
Nov 16 00:43:54 user nova-compute[75826]:     </serial>
Nov 16 00:43:54 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:43:54 user nova-compute[75826]:     <video>
Nov 16 00:43:54 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:43:54 user nova-compute[75826]:     </video>
Nov 16 00:43:54 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:43:54 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:43:54 user nova-compute[75826]:     </rng>
Nov 16 00:43:54 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:43:54 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:43:54 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:43:54 user nova-compute[75826]:     </memballoon>
Nov 16 00:43:54 user nova-compute[75826]:   </devices>
Nov 16 00:43:54 user nova-compute[75826]: </domain>
Nov 16 00:43:54 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-917628068',display_name='tempest-TestStampPattern-server-917628068',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-917628068',id=18,image_ref='182a3508-62d9-4ea2-ad79-8a25af60da10',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnVOKXX9r1n1SeXR18FAZ5ReiXMg6r0YfIpLL5KrVybqfFaIfm7SGvy2MKiB0irAegI0W1yk67LwVXLx0F4yvrQoFAmD1fY1rcoS5KnlcevqtmC0fE4TYt7AS0e05sCcw==',key_name='tempest-TestStampPattern-2032325257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='151c8475c39a472b9f99d7b94752e148',ramdisk_id='',reservation_id='r-gsd162wh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25',image_min_disk='1',image_min_ram='0',image_owner_id='151c8475c39a472b9f99d7b94752e148',image_owner_project_name='tempest-TestStampPattern-1037297845',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1037297845-project-member',image_user_id='5562a4fee0d14187bcb346ba5a4634af',network_allocated='True',owner_project_name='tempest-TestStampPattern-1037297845',owner_user_name='tempest-TestStampPattern-1037297845-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:43:51Z,user_data=None,user_id='5562a4fee0d14187bcb346ba5a4634af',uuid=eeb0e320-431c-44ad-bbb9-3eda75234ed1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "address": "fa:16:3e:a9:78:21", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4e57-60", "ovs_interfaceid": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Converting VIF {"id": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "address": "fa:16:3e:a9:78:21", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4e57-60", "ovs_interfaceid": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:78:21,bridge_name='br-int',has_traffic_filtering=True,id=9eca4e57-6005-41bb-b05b-3fb5793ffc88,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4e57-60') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG os_vif [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:78:21,bridge_name='br-int',has_traffic_filtering=True,id=9eca4e57-6005-41bb-b05b-3fb5793ffc88,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4e57-60') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '58c1ee75-65b2-5b64-94a4-4bb55b48ff04', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9eca4e57-60, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9eca4e57-60, col_values=(('qos', UUID('5bc8782c-b295-4a20-87a4-2b73dcedf001')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9eca4e57-60, col_values=(('external_ids', {'iface-id': '9eca4e57-6005-41bb-b05b-3fb5793ffc88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:78:21', 'vm-uuid': 'eeb0e320-431c-44ad-bbb9-3eda75234ed1'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:54 user nova-compute[75826]: INFO os_vif [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:78:21,bridge_name='br-int',has_traffic_filtering=True,id=9eca4e57-6005-41bb-b05b-3fb5793ffc88,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4e57-60')
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:43:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] No VIF found with MAC fa:16:3e:a9:78:21, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:43:55 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:43:55 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:43:55 user nova-compute[75826]: DEBUG nova.network.neutron [req-f117ca3b-da51-40fb-9543-08cfa2e0c9ad req-ec73beb4-bfee-46ba-8579-78fd44b60829 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Updated VIF entry in instance network info cache for port 9eca4e57-6005-41bb-b05b-3fb5793ffc88. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:43:55 user nova-compute[75826]: DEBUG nova.network.neutron [req-f117ca3b-da51-40fb-9543-08cfa2e0c9ad req-ec73beb4-bfee-46ba-8579-78fd44b60829 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Updating instance_info_cache with network_info: [{"id": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "address": "fa:16:3e:a9:78:21", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4e57-60", "ovs_interfaceid": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:43:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f117ca3b-da51-40fb-9543-08cfa2e0c9ad req-ec73beb4-bfee-46ba-8579-78fd44b60829 service nova] Releasing lock "refresh_cache-eeb0e320-431c-44ad-bbb9-3eda75234ed1" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:43:55 user nova-compute[75826]: DEBUG nova.network.neutron [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Updating instance_info_cache with network_info: [{"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:43:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Releasing lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:43:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-93abf8fe-522f-4bc5-bb86-0bfc308d0b6d req-b41f5562-dee4-40b1-a2ea-88cc9b0d89bc service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-unplugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-93abf8fe-522f-4bc5-bb86-0bfc308d0b6d req-b41f5562-dee4-40b1-a2ea-88cc9b0d89bc service nova] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-93abf8fe-522f-4bc5-bb86-0bfc308d0b6d req-b41f5562-dee4-40b1-a2ea-88cc9b0d89bc service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-93abf8fe-522f-4bc5-bb86-0bfc308d0b6d req-b41f5562-dee4-40b1-a2ea-88cc9b0d89bc service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-93abf8fe-522f-4bc5-bb86-0bfc308d0b6d req-b41f5562-dee4-40b1-a2ea-88cc9b0d89bc service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] No waiting events found dispatching network-vif-unplugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:43:56 user nova-compute[75826]: WARNING nova.compute.manager [req-93abf8fe-522f-4bc5-bb86-0bfc308d0b6d req-b41f5562-dee4-40b1-a2ea-88cc9b0d89bc service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received unexpected event network-vif-unplugged-9a741ee6-00d4-49d0-8562-3ece777615c8 for instance with vm_state active and task_state rescuing.
Nov 16 00:43:56 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Instance destroyed successfully.
Nov 16 00:43:56 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Attempting a stable device rescue
Nov 16 00:43:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75826) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Instance directory exists: not creating {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 00:43:56 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Creating image(s)
Nov 16 00:43:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "/opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "/opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG nova.objects.instance [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "765d84e26d01a08dffe0be3b4e8ae6347300f748" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "765d84e26d01a08dffe0be3b4e8ae6347300f748" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748.part --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] No waiting events found dispatching network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:43:58 user nova-compute[75826]: WARNING nova.compute.manager [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received unexpected event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 for instance with vm_state active and task_state rescuing.
Nov 16 00:43:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Received event network-vif-plugged-9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] Acquiring lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] No waiting events found dispatching network-vif-plugged-9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:43:58 user nova-compute[75826]: WARNING nova.compute.manager [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Received unexpected event network-vif-plugged-9eca4e57-6005-41bb-b05b-3fb5793ffc88 for instance with vm_state building and task_state spawning.
Nov 16 00:43:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Received event network-vif-plugged-9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] Acquiring lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] No waiting events found dispatching network-vif-plugged-9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:43:58 user nova-compute[75826]: WARNING nova.compute.manager [req-1d18ff80-e65d-49f5-8d50-5ab19654a6fe req-4bdc03c5-b7df-4445-8002-8246ffa28e14 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Received unexpected event network-vif-plugged-9eca4e57-6005-41bb-b05b-3fb5793ffc88 for instance with vm_state building and task_state spawning.
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748.part --force-share --output=json" returned: 0 in 0.195s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG nova.virt.images [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] cc8cd53a-027e-42d7-9b8e-c1702a406822 was qcow2, converting to raw {{(pid=75826) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748.part /opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748.converted {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748.part /opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748.converted" returned: 0 in 0.438s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748.converted --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "765d84e26d01a08dffe0be3b4e8ae6347300f748" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.131s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "765d84e26d01a08dffe0be3b4e8ae6347300f748" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "765d84e26d01a08dffe0be3b4e8ae6347300f748" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748 --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748 --force-share --output=json" returned: 0 in 0.198s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748,backing_fmt=raw /opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.rescue {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748,backing_fmt=raw /opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.rescue" returned: 0 in 0.063s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "765d84e26d01a08dffe0be3b4e8ae6347300f748" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.objects.instance [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'migration_context' on Instance uuid 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.objects.base [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Object Instance<2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Start _get_guest_xml network_info=[{"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "vif_mac": "fa:16:3e:f5:64:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cc8cd53a-027e-42d7-9b8e-c1702a406822', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '192aaa26-8e1c-4b8e-bae3-c3990f0b8f76', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZOvXJio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c', 'attached_at': '', 'detached_at': '', 'volume_id': 'b7e39321-f2f6-44b8-88ce-6ea0337e7857', 'serial': 'b7e39321-f2f6-44b8-88ce-6ea0337e7857'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.objects.instance [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'resources' on Instance uuid 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.objects.base [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Object Instance<2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.objects.instance [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'numa_topology' on Instance uuid 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.objects.base [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Object Instance<2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:43:59 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:43:59 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.compute.manager [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.objects.instance [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:43:59 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Instance spawned successfully.
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.objects.base [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Object Instance<2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZOvXJio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:43:59 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:43:59 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:43:59 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27ff7d0-2086-42c1-ba2c-4b3e04e110cb]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GZOvXJio\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 00:43:59 user nova-compute[75826]: node.name = iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:43:59 user nova-compute[75826]: node.tpgt = -1
Nov 16 00:43:59 user nova-compute[75826]: node.startup = automatic
Nov 16 00:43:59 user nova-compute[75826]: node.leading_login = No
Nov 16 00:43:59 user nova-compute[75826]: iface.iscsi_ifacename = default
Nov 16 00:43:59 user nova-compute[75826]: iface.net_ifacename = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.ipaddress = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.prefix_len = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.hwaddress = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.transport_name = tcp
Nov 16 00:43:59 user nova-compute[75826]: iface.initiatorname = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.state = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.vlan_id = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.vlan_priority = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.vlan_state = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.iface_num = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.mtu = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.port = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.bootproto = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.subnet_mask = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.gateway = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.dhcp_alt_client_id = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.dhcp_dns = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.dhcp_learn_iqn = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.dhcp_vendor_id_state = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.dhcp_vendor_id = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.dhcp_slp_da = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.fragmentation = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.gratuitous_arp = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.incoming_forwarding = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.tos_state = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.tos = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.ttl = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.delayed_ack = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.tcp_nagle = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.tcp_wsf_state = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.tcp_wsf = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.tcp_timer_scale = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.tcp_timestamp = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.redirect = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.def_task_mgmt_timeout = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.header_digest = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.data_digest = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.immediate_data = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.initial_r2t = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.data_seq_inorder = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.data_pdu_inorder = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.erl = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.max_receive_data_len = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.first_burst_len = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.max_outstanding_r2t = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.max_burst_len = 0
Nov 16 00:43:59 user nova-compute[75826]: iface.chap_auth = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.bidi_chap = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.strict_login_compliance = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.discovery_auth = <empty>
Nov 16 00:43:59 user nova-compute[75826]: iface.discovery_logout = <empty>
Nov 16 00:43:59 user nova-compute[75826]: node.discovery_address = <empty>
Nov 16 00:43:59 user nova-compute[75826]: node.discovery_port = 0
Nov 16 00:43:59 user nova-compute[75826]: node.discovery_type = static
Nov 16 00:43:59 user nova-compute[75826]: node.session.initial_cmdsn = 0
Nov 16 00:43:59 user nova-compute[75826]: node.session.initial_login_retry_max = 8
Nov 16 00:43:59 user nova-compute[75826]: node.session.xmit_thread_priority = -20
Nov 16 00:43:59 user nova-compute[75826]: node.session.cmds_max = 128
Nov 16 00:43:59 user nova-compute[75826]: node.session.queue_depth = 32
Nov 16 00:43:59 user nova-compute[75826]: node.session.nr_sessions = 1
Nov 16 00:43:59 user nova-compute[75826]: node.session.auth.authmethod = CHAP
Nov 16 00:43:59 user nova-compute[75826]: node.session.auth.username = GZOvXJio
Nov 16 00:43:59 user nova-compute[75826]: node.session.auth.password = ***
Nov 16 00:43:59 user nova-compute[75826]: node.session.auth.username_in = <empty>
Nov 16 00:43:59 user nova-compute[75826]: node.session.auth.password_in = <empty>
Nov 16 00:43:59 user nova-compute[75826]: node.session.auth.chap_algs = MD5
Nov 16 00:43:59 user nova-compute[75826]: node.session.timeo.replacement_timeout = 120
Nov 16 00:43:59 user nova-compute[75826]: node.session.err_timeo.abort_timeout = 15
Nov 16 00:43:59 user nova-compute[75826]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 00:43:59 user nova-compute[75826]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 00:43:59 user nova-compute[75826]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 00:43:59 user nova-compute[75826]: node.session.iscsi.FastAbort = Yes
Nov 16 00:43:59 user nova-compute[75826]: node.session.iscsi.InitialR2T = No
Nov 16 00:43:59 user nova-compute[75826]: node.session.iscsi.ImmediateData = Yes
Nov 16 00:43:59 user nova-compute[75826]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 00:43:59 user nova-compute[75826]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 00:43:59 user nova-compute[75826]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 00:43:59 user nova-compute[75826]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 00:43:59 user nova-compute[75826]: node.session.iscsi.MaxConnections = 1
Nov 16 00:43:59 user nova-compute[75826]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 00:43:59 user nova-compute[75826]: node.session.iscsi.ERL = 0
Nov 16 00:43:59 user nova-compute[75826]: node.session.scan = manual
Nov 16 00:43:59 user nova-compute[75826]: node.session.reopen_max = 0
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].address = 172.16.0.220
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].port = 3260
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].startup = manual
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].tcp.window_size = 524288
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].tcp.type_of_service = 0
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].timeo.logout_timeout = 15
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].timeo.login_timeout = 15
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].timeo.auth_timeout = 45
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].iscsi.DataDigest = None
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].iscsi.IFMarker = No
Nov 16 00:43:59 user nova-compute[75826]: node.conn[0].iscsi.OFMarker = No
Nov 16 00:43:59 user nova-compute[75826]: # END RECORD
Nov 16 00:43:59 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:59 user nova-compute[75826]: INFO nova.compute.manager [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Took 8.71 seconds to spawn the instance on the hypervisor.
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.compute.manager [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad892e3a-58b5-4e4d-adb3-d029a3816ac5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3933dcb-da5e-4f7f-b835-c8aeebed90d7]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZOvXJio {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GZOvXJio" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3757bf0a-544f-42bd-af3b-7a815ae43fac]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GZOvXJio'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:59 user nova-compute[75826]: INFO nova.compute.manager [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Took 9.85 seconds to build instance.
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc7d1a4-6c40-4b0d-a60e-bbebf3b025be]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1e5b5a91-7f33-4bd7-8eab-3f7585d67294 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.564s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e1e9bf-6586-496d-9528-3d9a2897e62b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:59 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:43:59 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:43:59 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:43:59 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.250s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] HCTL ('33', '0', '0', 0) found on session 13 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dd14ac-3985-4175-bcbd-0effc8e4cd48]: (4, ('0 0 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching for a device in session 13 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZOvXJio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.276s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] <== connect_volume: return (277ms) {'type': 'block', 'scsi_wwn': '23939633531326431', 'path': '/dev/sdb'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939633531326431', 'path': '/dev/sdb'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1180544394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1180544394',id=13,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:42:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-wr2i12dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:42:20Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "vif_mac": "fa:16:3e:f5:64:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "vif_mac": "fa:16:3e:f5:64:fa"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:64:fa,bridge_name='br-int',has_traffic_filtering=True,id=9a741ee6-00d4-49d0-8562-3ece777615c8,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a741ee6-00') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.objects.instance [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.objects.base [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Object Instance<2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:43:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:43:59 user nova-compute[75826]:   <uuid>2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c</uuid>
Nov 16 00:43:59 user nova-compute[75826]:   <name>instance-0000000d</name>
Nov 16 00:43:59 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:43:59 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:43:59 user nova-compute[75826]:   <metadata>
Nov 16 00:43:59 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:43:59 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:43:59 user nova-compute[75826]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1180544394</nova:name>
Nov 16 00:43:59 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:43:59</nova:creationTime>
Nov 16 00:43:59 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:43:59 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:43:59 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:43:59 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:43:59 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:43:59 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:43:59 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:43:59 user nova-compute[75826]:       <nova:owner>
Nov 16 00:43:59 user nova-compute[75826]:         <nova:user uuid="f8606321461c403cbec7f0a36e454bc8">tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member</nova:user>
Nov 16 00:43:59 user nova-compute[75826]:         <nova:project uuid="e45c7fd936b74e109f83fc69060af216">tempest-ServerBootFromVolumeStableRescueTest-1116494461</nova:project>
Nov 16 00:43:59 user nova-compute[75826]:       </nova:owner>
Nov 16 00:43:59 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:43:59 user nova-compute[75826]:       <nova:ports>
Nov 16 00:43:59 user nova-compute[75826]:         <nova:port uuid="9a741ee6-00d4-49d0-8562-3ece777615c8">
Nov 16 00:43:59 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 00:43:59 user nova-compute[75826]:         </nova:port>
Nov 16 00:43:59 user nova-compute[75826]:       </nova:ports>
Nov 16 00:43:59 user nova-compute[75826]:     </nova:instance>
Nov 16 00:43:59 user nova-compute[75826]:   </metadata>
Nov 16 00:43:59 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:43:59 user nova-compute[75826]:     <system>
Nov 16 00:43:59 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:43:59 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:43:59 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:43:59 user nova-compute[75826]:       <entry name="serial">2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c</entry>
Nov 16 00:43:59 user nova-compute[75826]:       <entry name="uuid">2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c</entry>
Nov 16 00:43:59 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:43:59 user nova-compute[75826]:     </system>
Nov 16 00:43:59 user nova-compute[75826]:   </sysinfo>
Nov 16 00:43:59 user nova-compute[75826]:   <os>
Nov 16 00:43:59 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:43:59 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:43:59 user nova-compute[75826]:   </os>
Nov 16 00:43:59 user nova-compute[75826]:   <features>
Nov 16 00:43:59 user nova-compute[75826]:     <acpi/>
Nov 16 00:43:59 user nova-compute[75826]:     <apic/>
Nov 16 00:43:59 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:43:59 user nova-compute[75826]:   </features>
Nov 16 00:43:59 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:43:59 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:43:59 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:43:59 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:43:59 user nova-compute[75826]:   </clock>
Nov 16 00:43:59 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:43:59 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:43:59 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:43:59 user nova-compute[75826]:   </cpu>
Nov 16 00:43:59 user nova-compute[75826]:   <devices>
Nov 16 00:43:59 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:43:59 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:43:59 user nova-compute[75826]:       <source dev="/dev/sdb"/>
Nov 16 00:43:59 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:43:59 user nova-compute[75826]:       <serial>b7e39321-f2f6-44b8-88ce-6ea0337e7857</serial>
Nov 16 00:43:59 user nova-compute[75826]:     </disk>
Nov 16 00:43:59 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:43:59 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:43:59 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.rescue"/>
Nov 16 00:43:59 user nova-compute[75826]:       <target dev="vdb" bus="virtio"/>
Nov 16 00:43:59 user nova-compute[75826]:       <boot order="1"/>
Nov 16 00:43:59 user nova-compute[75826]:     </disk>
Nov 16 00:43:59 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:43:59 user nova-compute[75826]:       <mac address="fa:16:3e:f5:64:fa"/>
Nov 16 00:43:59 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:43:59 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:43:59 user nova-compute[75826]:       <target dev="tap9a741ee6-00"/>
Nov 16 00:43:59 user nova-compute[75826]:     </interface>
Nov 16 00:43:59 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:43:59 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/console.log" append="off"/>
Nov 16 00:43:59 user nova-compute[75826]:     </serial>
Nov 16 00:43:59 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:43:59 user nova-compute[75826]:     <video>
Nov 16 00:43:59 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:43:59 user nova-compute[75826]:     </video>
Nov 16 00:43:59 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:43:59 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:43:59 user nova-compute[75826]:     </rng>
Nov 16 00:43:59 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:43:59 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:43:59 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:43:59 user nova-compute[75826]:     </memballoon>
Nov 16 00:43:59 user nova-compute[75826]:   </devices>
Nov 16 00:43:59 user nova-compute[75826]: </domain>
Nov 16 00:43:59 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:43:59 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Instance destroyed successfully.
Nov 16 00:43:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:44:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:44:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No VIF found with MAC fa:16:3e:f5:64:fa, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:44:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:44:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-798c2470-1091-4020-87f7-581bc27e562c req-c7cd0fb2-ebed-45c0-b223-f35c3d64ed03 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-changed-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-798c2470-1091-4020-87f7-581bc27e562c req-c7cd0fb2-ebed-45c0-b223-f35c3d64ed03 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Refreshing instance network info cache due to event network-changed-29ee5e10-3912-41da-a701-c5034a67f421. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-798c2470-1091-4020-87f7-581bc27e562c req-c7cd0fb2-ebed-45c0-b223-f35c3d64ed03 service nova] Acquiring lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-798c2470-1091-4020-87f7-581bc27e562c req-c7cd0fb2-ebed-45c0-b223-f35c3d64ed03 service nova] Acquired lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG nova.network.neutron [req-798c2470-1091-4020-87f7-581bc27e562c req-c7cd0fb2-ebed-45c0-b223-f35c3d64ed03 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Refreshing network info cache for port 29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:44:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:03 user nova-compute[75826]: DEBUG nova.network.neutron [req-798c2470-1091-4020-87f7-581bc27e562c req-c7cd0fb2-ebed-45c0-b223-f35c3d64ed03 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updated VIF entry in instance network info cache for port 29ee5e10-3912-41da-a701-c5034a67f421. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:44:03 user nova-compute[75826]: DEBUG nova.network.neutron [req-798c2470-1091-4020-87f7-581bc27e562c req-c7cd0fb2-ebed-45c0-b223-f35c3d64ed03 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updating instance_info_cache with network_info: [{"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-798c2470-1091-4020-87f7-581bc27e562c req-c7cd0fb2-ebed-45c0-b223-f35c3d64ed03 service nova] Releasing lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:04 user nova-compute[75826]: DEBUG nova.compute.manager [None req-60351683-d0fd-45c3-a59c-fdd866f2dd15 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:44:04 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:44:04 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:44:04 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7389MB free_disk=25.327442169189453GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:44:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Applying migration context for instance 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 as it has an incoming, in-progress migration c39a107f-a195-4679-897b-99f03b3e585a. Migration status is finished {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 00:44:05 user nova-compute[75826]: INFO nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating resource usage from migration c39a107f-a195-4679-897b-99f03b3e585a
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance d9ac6719-80f7-490a-a51e-869b51118aa2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 298aaae2-dd4e-412a-8afb-dfaafbd36964 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Migration c39a107f-a195-4679-897b-99f03b3e585a is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 298c8986-b91b-4f46-bcce-75e28bc02b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance eeb0e320-431c-44ad-bbb9-3eda75234ed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:44:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.827s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:06 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:44:06 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:44:06 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:44:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-d9ac6719-80f7-490a-a51e-869b51118aa2" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-d9ac6719-80f7-490a-a51e-869b51118aa2" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:06 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:44:07 user nova-compute[75826]: DEBUG nova.compute.manager [req-f86da907-b49f-43be-9b3c-c044994b8cfb req-69d3f47f-1027-4bfd-9a05-83b12680fa3e service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f86da907-b49f-43be-9b3c-c044994b8cfb req-69d3f47f-1027-4bfd-9a05-83b12680fa3e service nova] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f86da907-b49f-43be-9b3c-c044994b8cfb req-69d3f47f-1027-4bfd-9a05-83b12680fa3e service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f86da907-b49f-43be-9b3c-c044994b8cfb req-69d3f47f-1027-4bfd-9a05-83b12680fa3e service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:07 user nova-compute[75826]: DEBUG nova.compute.manager [req-f86da907-b49f-43be-9b3c-c044994b8cfb req-69d3f47f-1027-4bfd-9a05-83b12680fa3e service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] No waiting events found dispatching network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:07 user nova-compute[75826]: WARNING nova.compute.manager [req-f86da907-b49f-43be-9b3c-c044994b8cfb req-69d3f47f-1027-4bfd-9a05-83b12680fa3e service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received unexpected event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 for instance with vm_state rescued and task_state None.
Nov 16 00:44:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:07 user nova-compute[75826]: INFO nova.compute.manager [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Shelving
Nov 16 00:44:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Updating instance_info_cache with network_info: [{"id": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "address": "fa:16:3e:03:9a:ea", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7134fec-93", "ovs_interfaceid": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-d9ac6719-80f7-490a-a51e-869b51118aa2" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG nova.compute.manager [req-f31255c3-bbfa-450d-9976-9d3749f968b8 req-cb6cde3b-cb19-4fa3-8def-5afeaa1ebf9c service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-unplugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f31255c3-bbfa-450d-9976-9d3749f968b8 req-cb6cde3b-cb19-4fa3-8def-5afeaa1ebf9c service nova] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f31255c3-bbfa-450d-9976-9d3749f968b8 req-cb6cde3b-cb19-4fa3-8def-5afeaa1ebf9c service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f31255c3-bbfa-450d-9976-9d3749f968b8 req-cb6cde3b-cb19-4fa3-8def-5afeaa1ebf9c service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:08 user nova-compute[75826]: DEBUG nova.compute.manager [req-f31255c3-bbfa-450d-9976-9d3749f968b8 req-cb6cde3b-cb19-4fa3-8def-5afeaa1ebf9c service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] No waiting events found dispatching network-vif-unplugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:08 user nova-compute[75826]: WARNING nova.compute.manager [req-f31255c3-bbfa-450d-9976-9d3749f968b8 req-cb6cde3b-cb19-4fa3-8def-5afeaa1ebf9c service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received unexpected event network-vif-unplugged-29ee5e10-3912-41da-a701-c5034a67f421 for instance with vm_state active and task_state shelving.
Nov 16 00:44:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:08 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Instance destroyed successfully.
Nov 16 00:44:09 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Beginning cold snapshot process
Nov 16 00:44:09 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:44:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk /opt/stack/data/nova/instances/snapshots/tmpy_1po8if/6d1ce6a4e7b74cfd8d2a36061c91688a {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-a7f01654-54c5-46af-8a83-1e987899f067 req-8abccbf0-0efe-4eb6-a9dc-51216733223d service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a7f01654-54c5-46af-8a83-1e987899f067 req-8abccbf0-0efe-4eb6-a9dc-51216733223d service nova] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a7f01654-54c5-46af-8a83-1e987899f067 req-8abccbf0-0efe-4eb6-a9dc-51216733223d service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a7f01654-54c5-46af-8a83-1e987899f067 req-8abccbf0-0efe-4eb6-a9dc-51216733223d service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-a7f01654-54c5-46af-8a83-1e987899f067 req-8abccbf0-0efe-4eb6-a9dc-51216733223d service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] No waiting events found dispatching network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:09 user nova-compute[75826]: WARNING nova.compute.manager [req-a7f01654-54c5-46af-8a83-1e987899f067 req-8abccbf0-0efe-4eb6-a9dc-51216733223d service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received unexpected event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 for instance with vm_state rescued and task_state None.
Nov 16 00:44:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk /opt/stack/data/nova/instances/snapshots/tmpy_1po8if/6d1ce6a4e7b74cfd8d2a36061c91688a" returned: 0 in 0.882s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:10 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Snapshot extracted, beginning image upload
Nov 16 00:44:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-a6de0aef-08a9-4ba4-b59a-838d5fcbd639 req-e6a6a884-ee7c-4b35-87ce-ba596a160ac4 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a6de0aef-08a9-4ba4-b59a-838d5fcbd639 req-e6a6a884-ee7c-4b35-87ce-ba596a160ac4 service nova] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a6de0aef-08a9-4ba4-b59a-838d5fcbd639 req-e6a6a884-ee7c-4b35-87ce-ba596a160ac4 service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a6de0aef-08a9-4ba4-b59a-838d5fcbd639 req-e6a6a884-ee7c-4b35-87ce-ba596a160ac4 service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-a6de0aef-08a9-4ba4-b59a-838d5fcbd639 req-e6a6a884-ee7c-4b35-87ce-ba596a160ac4 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] No waiting events found dispatching network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:11 user nova-compute[75826]: WARNING nova.compute.manager [req-a6de0aef-08a9-4ba4-b59a-838d5fcbd639 req-e6a6a884-ee7c-4b35-87ce-ba596a160ac4 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received unexpected event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 00:44:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:13 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Snapshot image upload complete
Nov 16 00:44:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:44:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "7c67f025-987e-435c-b1d9-7936832fe72b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:44:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:14 user nova-compute[75826]: INFO nova.compute.manager [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Shelve offloading
Nov 16 00:44:14 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Instance destroyed successfully.
Nov 16 00:44:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquired lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:44:14 user nova-compute[75826]: INFO nova.compute.claims [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Claim successful on node user
Nov 16 00:44:14 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updating instance_info_cache with network_info: [{"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Releasing lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.775s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "298aaae2-dd4e-412a-8afb-dfaafbd36964" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:14 user nova-compute[75826]: INFO nova.compute.manager [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Terminating instance
Nov 16 00:44:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG nova.network.neutron [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:44:14 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:44:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:44:15 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Creating image(s)
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "/opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "/opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "/opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.244s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-dad114eb-9004-4c26-a84a-c4c8b76ff717 req-9014d00a-c26d-4181-9d8a-8ac4273f84fd service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Received event network-vif-unplugged-e111e80e-fa44-4274-9130-728acbf11cce {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dad114eb-9004-4c26-a84a-c4c8b76ff717 req-9014d00a-c26d-4181-9d8a-8ac4273f84fd service nova] Acquiring lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dad114eb-9004-4c26-a84a-c4c8b76ff717 req-9014d00a-c26d-4181-9d8a-8ac4273f84fd service nova] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dad114eb-9004-4c26-a84a-c4c8b76ff717 req-9014d00a-c26d-4181-9d8a-8ac4273f84fd service nova] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-dad114eb-9004-4c26-a84a-c4c8b76ff717 req-9014d00a-c26d-4181-9d8a-8ac4273f84fd service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] No waiting events found dispatching network-vif-unplugged-e111e80e-fa44-4274-9130-728acbf11cce {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-dad114eb-9004-4c26-a84a-c4c8b76ff717 req-9014d00a-c26d-4181-9d8a-8ac4273f84fd service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Received event network-vif-unplugged-e111e80e-fa44-4274-9130-728acbf11cce for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.policy [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4db0919906cd443d893ab4b884d5f454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '288f933627b44a62b64e093c6a57d6a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.196s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk 1073741824" returned: 0 in 0.074s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:15 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Instance destroyed successfully.
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lazy-loading 'resources' on Instance uuid 298aaae2-dd4e-412a-8afb-dfaafbd36964 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:42:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1303689510',display_name='tempest-VolumesAdminNegativeTest-server-1303689510',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1303689510',id=15,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:42:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f6aa796a8fb4ea79988055543768456',ramdisk_id='',reservation_id='r-jzuu6kzc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1306204197',owner_user_name='tempest-VolumesAdminNegativeTest-1306204197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:42:25Z,user_data=None,user_id='a021a407de284df491fe3dc7b0608403',uuid=298aaae2-dd4e-412a-8afb-dfaafbd36964,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e111e80e-fa44-4274-9130-728acbf11cce", "address": "fa:16:3e:83:bc:24", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape111e80e-fa", "ovs_interfaceid": "e111e80e-fa44-4274-9130-728acbf11cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Converting VIF {"id": "e111e80e-fa44-4274-9130-728acbf11cce", "address": "fa:16:3e:83:bc:24", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape111e80e-fa", "ovs_interfaceid": "e111e80e-fa44-4274-9130-728acbf11cce", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:bc:24,bridge_name='br-int',has_traffic_filtering=True,id=e111e80e-fa44-4274-9130-728acbf11cce,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape111e80e-fa') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG os_vif [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:bc:24,bridge_name='br-int',has_traffic_filtering=True,id=e111e80e-fa44-4274-9130-728acbf11cce,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape111e80e-fa') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape111e80e-fa, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=365c8e64-adac-47f9-aee5-59c57756737f) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:15 user nova-compute[75826]: INFO os_vif [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:bc:24,bridge_name='br-int',has_traffic_filtering=True,id=e111e80e-fa44-4274-9130-728acbf11cce,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape111e80e-fa')
Nov 16 00:44:15 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Deleting instance files /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964_del
Nov 16 00:44:15 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Deletion of /opt/stack/data/nova/instances/298aaae2-dd4e-412a-8afb-dfaafbd36964_del complete
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:15 user nova-compute[75826]: INFO nova.compute.manager [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Took 1.11 seconds to destroy the instance on the hypervisor.
Nov 16 00:44:15 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:44:15 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Instance destroyed successfully.
Nov 16 00:44:15 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'resources' on Instance uuid 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1545772247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1545772247',id=14,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5B66Qf+MQGsHfinCxf1C+yam25N2g58fRRofO5wiRA1j5R2phnunwEELoIaU0Cin2x5UxLqXlSqPNgeM2aMFAQihMiJ2zI238LG+ZeDaRhOUk0Ki09+Ilf/kkDnLo82w==',key_name='tempest-keypair-48608115',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c770637392a544c48a72c953bfd9e7c6',ramdisk_id='',reservation_id='r-r9359cng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849437325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849437325-project-member',shelved_at='2023-11-16T00:44:13.916038',shelved_host='user',shelved_image_id='f71807b8-2b40-473b-880f-4c850d3bcec8'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:44:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a858d73834524c86a1c5c8514270761e',uuid=5fdf32cf-b23f-4b65-8a47-1cf913b950d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converting VIF {"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG os_vif [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29ee5e10-39, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0cbbeeef-0b7f-4b80-ad89-f432391b1381) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:44:16 user nova-compute[75826]: INFO os_vif [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39')
Nov 16 00:44:16 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Deleting instance files /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9_del
Nov 16 00:44:16 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Deletion of /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9_del complete
Nov 16 00:44:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Cannot resize image /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Ensure instance console log exists: /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:16 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Deleted allocations for instance 5fdf32cf-b23f-4b65-8a47-1cf913b950d9
Nov 16 00:44:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'numa_topology' on Instance uuid 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:44:16 user nova-compute[75826]: DEBUG nova.objects.base [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Object Instance<5fdf32cf-b23f-4b65-8a47-1cf913b950d9> lazy-loaded attributes: resources,numa_topology {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG nova.network.neutron [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Successfully created port: b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Received event network-vif-plugged-e111e80e-fa44-4274-9130-728acbf11cce {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] Acquiring lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] No waiting events found dispatching network-vif-plugged-e111e80e-fa44-4274-9130-728acbf11cce {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:17 user nova-compute[75826]: WARNING nova.compute.manager [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Received unexpected event network-vif-plugged-e111e80e-fa44-4274-9130-728acbf11cce for instance with vm_state active and task_state deleting.
Nov 16 00:44:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-changed-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Refreshing instance network info cache due to event network-changed-29ee5e10-3912-41da-a701-c5034a67f421. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] Acquiring lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] Acquired lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG nova.network.neutron [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Refreshing network info cache for port 29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.635s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6bde1cef-2f96-4b51-9648-d0ceec1445a9 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.762s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:17 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Took 1.88 seconds to deallocate network for instance.
Nov 16 00:44:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.network.neutron [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Successfully updated port: b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "refresh_cache-7c67f025-987e-435c-b1d9-7936832fe72b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquired lock "refresh_cache-7c67f025-987e-435c-b1d9-7936832fe72b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.network.neutron [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.network.neutron [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.compute.manager [req-e06fa5a1-e38f-474d-a0e2-626eabbad4e4 req-a99fcc2a-a90d-4b8f-a03f-4983e32e0805 service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Received event network-changed-b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.compute.manager [req-e06fa5a1-e38f-474d-a0e2-626eabbad4e4 req-a99fcc2a-a90d-4b8f-a03f-4983e32e0805 service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Refreshing instance network info cache due to event network-changed-b5701d2a-63a8-4968-bec1-7aa295b81b60. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e06fa5a1-e38f-474d-a0e2-626eabbad4e4 req-a99fcc2a-a90d-4b8f-a03f-4983e32e0805 service nova] Acquiring lock "refresh_cache-7c67f025-987e-435c-b1d9-7936832fe72b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.481s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.network.neutron [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updated VIF entry in instance network info cache for port 29ee5e10-3912-41da-a701-c5034a67f421. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.network.neutron [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updating instance_info_cache with network_info: [{"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap29ee5e10-39", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.network.neutron [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Updating instance_info_cache with network_info: [{"id": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "address": "fa:16:3e:5c:fa:48", "network": {"id": "536b4ba3-0a32-4ae8-b94b-f095d82c8d9e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1917941408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "288f933627b44a62b64e093c6a57d6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5701d2a-63", "ovs_interfaceid": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1749b902-62ae-4112-b836-e05412b8a135 req-ccf1c824-f8a7-4fe9-8cb0-1bff9f2952d8 service nova] Releasing lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Releasing lock "refresh_cache-7c67f025-987e-435c-b1d9-7936832fe72b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.compute.manager [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Instance network_info: |[{"id": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "address": "fa:16:3e:5c:fa:48", "network": {"id": "536b4ba3-0a32-4ae8-b94b-f095d82c8d9e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1917941408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "288f933627b44a62b64e093c6a57d6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5701d2a-63", "ovs_interfaceid": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e06fa5a1-e38f-474d-a0e2-626eabbad4e4 req-a99fcc2a-a90d-4b8f-a03f-4983e32e0805 service nova] Acquired lock "refresh_cache-7c67f025-987e-435c-b1d9-7936832fe72b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.network.neutron [req-e06fa5a1-e38f-474d-a0e2-626eabbad4e4 req-a99fcc2a-a90d-4b8f-a03f-4983e32e0805 service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Refreshing network info cache for port b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Start _get_guest_xml network_info=[{"id": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "address": "fa:16:3e:5c:fa:48", "network": {"id": "536b4ba3-0a32-4ae8-b94b-f095d82c8d9e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1917941408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "288f933627b44a62b64e093c6a57d6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5701d2a-63", "ovs_interfaceid": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:44:18 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:44:18 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:44:18 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Deleted allocations for instance 298aaae2-dd4e-412a-8afb-dfaafbd36964
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-817836755',display_name='tempest-TestVolumeSwap-server-817836755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-817836755',id=19,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7moLRH490xIbcJvcFk95rGBPLvXKk9uLJ3cySWPbIOgapbJepJip/nbQo1QkoAt4sFKeHE2SOh0fciQ/T3YqSKeTJ0Is6r40FkTAy/qhVdqhZLf5/JErPLemXGOgRzPQ==',key_name='tempest-keypair-1781236172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='288f933627b44a62b64e093c6a57d6a7',ramdisk_id='',reservation_id='r-fq8oghmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-832049961',owner_user_name='tempest-TestVolumeSwap-832049961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4db0919906cd443d893ab4b884d5f454',uuid=7c67f025-987e-435c-b1d9-7936832fe72b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "address": "fa:16:3e:5c:fa:48", "network": {"id": "536b4ba3-0a32-4ae8-b94b-f095d82c8d9e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1917941408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "288f933627b44a62b64e093c6a57d6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5701d2a-63", "ovs_interfaceid": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Converting VIF {"id": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "address": "fa:16:3e:5c:fa:48", "network": {"id": "536b4ba3-0a32-4ae8-b94b-f095d82c8d9e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1917941408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "288f933627b44a62b64e093c6a57d6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5701d2a-63", "ovs_interfaceid": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fa:48,bridge_name='br-int',has_traffic_filtering=True,id=b5701d2a-63a8-4968-bec1-7aa295b81b60,network=Network(536b4ba3-0a32-4ae8-b94b-f095d82c8d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5701d2a-63') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.objects.instance [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c67f025-987e-435c-b1d9-7936832fe72b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:44:18 user nova-compute[75826]:   <uuid>7c67f025-987e-435c-b1d9-7936832fe72b</uuid>
Nov 16 00:44:18 user nova-compute[75826]:   <name>instance-00000013</name>
Nov 16 00:44:18 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:44:18 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:44:18 user nova-compute[75826]:   <metadata>
Nov 16 00:44:18 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:44:18 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:44:18 user nova-compute[75826]:       <nova:name>tempest-TestVolumeSwap-server-817836755</nova:name>
Nov 16 00:44:18 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:44:18</nova:creationTime>
Nov 16 00:44:18 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:44:18 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:44:18 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:44:18 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:44:18 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:44:18 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:44:18 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:44:18 user nova-compute[75826]:       <nova:owner>
Nov 16 00:44:18 user nova-compute[75826]:         <nova:user uuid="4db0919906cd443d893ab4b884d5f454">tempest-TestVolumeSwap-832049961-project-member</nova:user>
Nov 16 00:44:18 user nova-compute[75826]:         <nova:project uuid="288f933627b44a62b64e093c6a57d6a7">tempest-TestVolumeSwap-832049961</nova:project>
Nov 16 00:44:18 user nova-compute[75826]:       </nova:owner>
Nov 16 00:44:18 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:44:18 user nova-compute[75826]:       <nova:ports>
Nov 16 00:44:18 user nova-compute[75826]:         <nova:port uuid="b5701d2a-63a8-4968-bec1-7aa295b81b60">
Nov 16 00:44:18 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 00:44:18 user nova-compute[75826]:         </nova:port>
Nov 16 00:44:18 user nova-compute[75826]:       </nova:ports>
Nov 16 00:44:18 user nova-compute[75826]:     </nova:instance>
Nov 16 00:44:18 user nova-compute[75826]:   </metadata>
Nov 16 00:44:18 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:44:18 user nova-compute[75826]:     <system>
Nov 16 00:44:18 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:44:18 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:44:18 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:44:18 user nova-compute[75826]:       <entry name="serial">7c67f025-987e-435c-b1d9-7936832fe72b</entry>
Nov 16 00:44:18 user nova-compute[75826]:       <entry name="uuid">7c67f025-987e-435c-b1d9-7936832fe72b</entry>
Nov 16 00:44:18 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:44:18 user nova-compute[75826]:     </system>
Nov 16 00:44:18 user nova-compute[75826]:   </sysinfo>
Nov 16 00:44:18 user nova-compute[75826]:   <os>
Nov 16 00:44:18 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:44:18 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:44:18 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:44:18 user nova-compute[75826]:   </os>
Nov 16 00:44:18 user nova-compute[75826]:   <features>
Nov 16 00:44:18 user nova-compute[75826]:     <acpi/>
Nov 16 00:44:18 user nova-compute[75826]:     <apic/>
Nov 16 00:44:18 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:44:18 user nova-compute[75826]:   </features>
Nov 16 00:44:18 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:44:18 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:44:18 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:44:18 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:44:18 user nova-compute[75826]:   </clock>
Nov 16 00:44:18 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:44:18 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:44:18 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:44:18 user nova-compute[75826]:   </cpu>
Nov 16 00:44:18 user nova-compute[75826]:   <devices>
Nov 16 00:44:18 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:44:18 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:44:18 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk"/>
Nov 16 00:44:18 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:44:18 user nova-compute[75826]:     </disk>
Nov 16 00:44:18 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:44:18 user nova-compute[75826]:       <mac address="fa:16:3e:5c:fa:48"/>
Nov 16 00:44:18 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:44:18 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:44:18 user nova-compute[75826]:       <target dev="tapb5701d2a-63"/>
Nov 16 00:44:18 user nova-compute[75826]:     </interface>
Nov 16 00:44:18 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:44:18 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/console.log" append="off"/>
Nov 16 00:44:18 user nova-compute[75826]:     </serial>
Nov 16 00:44:18 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:44:18 user nova-compute[75826]:     <video>
Nov 16 00:44:18 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:44:18 user nova-compute[75826]:     </video>
Nov 16 00:44:18 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:44:18 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:44:18 user nova-compute[75826]:     </rng>
Nov 16 00:44:18 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:44:18 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:44:18 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:44:18 user nova-compute[75826]:     </memballoon>
Nov 16 00:44:18 user nova-compute[75826]:   </devices>
Nov 16 00:44:18 user nova-compute[75826]: </domain>
Nov 16 00:44:18 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-817836755',display_name='tempest-TestVolumeSwap-server-817836755',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-817836755',id=19,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7moLRH490xIbcJvcFk95rGBPLvXKk9uLJ3cySWPbIOgapbJepJip/nbQo1QkoAt4sFKeHE2SOh0fciQ/T3YqSKeTJ0Is6r40FkTAy/qhVdqhZLf5/JErPLemXGOgRzPQ==',key_name='tempest-keypair-1781236172',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='288f933627b44a62b64e093c6a57d6a7',ramdisk_id='',reservation_id='r-fq8oghmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-832049961',owner_user_name='tempest-TestVolumeSwap-832049961-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4db0919906cd443d893ab4b884d5f454',uuid=7c67f025-987e-435c-b1d9-7936832fe72b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "address": "fa:16:3e:5c:fa:48", "network": {"id": "536b4ba3-0a32-4ae8-b94b-f095d82c8d9e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1917941408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "288f933627b44a62b64e093c6a57d6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5701d2a-63", "ovs_interfaceid": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Converting VIF {"id": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "address": "fa:16:3e:5c:fa:48", "network": {"id": "536b4ba3-0a32-4ae8-b94b-f095d82c8d9e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1917941408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "288f933627b44a62b64e093c6a57d6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5701d2a-63", "ovs_interfaceid": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fa:48,bridge_name='br-int',has_traffic_filtering=True,id=b5701d2a-63a8-4968-bec1-7aa295b81b60,network=Network(536b4ba3-0a32-4ae8-b94b-f095d82c8d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5701d2a-63') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG os_vif [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fa:48,bridge_name='br-int',has_traffic_filtering=True,id=b5701d2a-63a8-4968-bec1-7aa295b81b60,network=Network(536b4ba3-0a32-4ae8-b94b-f095d82c8d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5701d2a-63') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1aaf5223-0c6e-57ac-bc0a-9787cac3bb73', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb5701d2a-63, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb5701d2a-63, col_values=(('qos', UUID('7e6570e5-40d5-4d34-ac1c-1bfa0197d5bc')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb5701d2a-63, col_values=(('external_ids', {'iface-id': 'b5701d2a-63a8-4968-bec1-7aa295b81b60', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:fa:48', 'vm-uuid': '7c67f025-987e-435c-b1d9-7936832fe72b'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:18 user nova-compute[75826]: INFO os_vif [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:fa:48,bridge_name='br-int',has_traffic_filtering=True,id=b5701d2a-63a8-4968-bec1-7aa295b81b60,network=Network(536b4ba3-0a32-4ae8-b94b-f095d82c8d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5701d2a-63')
Nov 16 00:44:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d4ed82eb-99c5-4951-8607-937fa88812e6 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "298aaae2-dd4e-412a-8afb-dfaafbd36964" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.980s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] No VIF found with MAC fa:16:3e:5c:fa:48, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:44:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "1621d261-aa12-4e57-a74e-fe565d921320" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "1621d261-aa12-4e57-a74e-fe565d921320" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:44:19 user nova-compute[75826]: DEBUG nova.network.neutron [req-e06fa5a1-e38f-474d-a0e2-626eabbad4e4 req-a99fcc2a-a90d-4b8f-a03f-4983e32e0805 service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Updated VIF entry in instance network info cache for port b5701d2a-63a8-4968-bec1-7aa295b81b60. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:44:19 user nova-compute[75826]: DEBUG nova.network.neutron [req-e06fa5a1-e38f-474d-a0e2-626eabbad4e4 req-a99fcc2a-a90d-4b8f-a03f-4983e32e0805 service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Updating instance_info_cache with network_info: [{"id": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "address": "fa:16:3e:5c:fa:48", "network": {"id": "536b4ba3-0a32-4ae8-b94b-f095d82c8d9e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1917941408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "288f933627b44a62b64e093c6a57d6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5701d2a-63", "ovs_interfaceid": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e06fa5a1-e38f-474d-a0e2-626eabbad4e4 req-a99fcc2a-a90d-4b8f-a03f-4983e32e0805 service nova] Releasing lock "refresh_cache-7c67f025-987e-435c-b1d9-7936832fe72b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:19 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:44:19 user nova-compute[75826]: INFO nova.compute.claims [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Claim successful on node user
Nov 16 00:44:19 user nova-compute[75826]: DEBUG nova.compute.manager [req-77f1bdc9-0b3e-4cb9-adc9-28245aa09a49 req-c6c98b76-489f-4333-af9d-2d087c0a84c5 service nova] [instance: 298aaae2-dd4e-412a-8afb-dfaafbd36964] Received event network-vif-deleted-e111e80e-fa44-4274-9130-728acbf11cce {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:19 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:44:19 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:44:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.620s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG nova.network.neutron [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:20 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:44:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG nova.policy [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f385e70b9fe4413b9870116e2367547', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd405b224d90942d6bd3188f6df34dcd1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:44:20 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Creating image(s)
Nov 16 00:44:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "/opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "/opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "/opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.237s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.237s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk 1073741824" returned: 0 in 0.061s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-6465130a-ac99-426f-9297-82c7fc09a1b2 req-876ba11d-f42f-415c-a43f-19d36bfd1a68 service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Received event network-vif-plugged-b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6465130a-ac99-426f-9297-82c7fc09a1b2 req-876ba11d-f42f-415c-a43f-19d36bfd1a68 service nova] Acquiring lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6465130a-ac99-426f-9297-82c7fc09a1b2 req-876ba11d-f42f-415c-a43f-19d36bfd1a68 service nova] Lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6465130a-ac99-426f-9297-82c7fc09a1b2 req-876ba11d-f42f-415c-a43f-19d36bfd1a68 service nova] Lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-6465130a-ac99-426f-9297-82c7fc09a1b2 req-876ba11d-f42f-415c-a43f-19d36bfd1a68 service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] No waiting events found dispatching network-vif-plugged-b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:21 user nova-compute[75826]: WARNING nova.compute.manager [req-6465130a-ac99-426f-9297-82c7fc09a1b2 req-876ba11d-f42f-415c-a43f-19d36bfd1a68 service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Received unexpected event network-vif-plugged-b5701d2a-63a8-4968-bec1-7aa295b81b60 for instance with vm_state building and task_state spawning.
Nov 16 00:44:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.235s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Cannot resize image /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Ensure instance console log exists: /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:21 user nova-compute[75826]: DEBUG nova.network.neutron [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Successfully created port: 8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.network.neutron [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Successfully updated port: 8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "refresh_cache-1621d261-aa12-4e57-a74e-fe565d921320" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquired lock "refresh_cache-1621d261-aa12-4e57-a74e-fe565d921320" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.network.neutron [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.network.neutron [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.network.neutron [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Updating instance_info_cache with network_info: [{"id": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "address": "fa:16:3e:5f:1e:f8", "network": {"id": "637cf6bb-6dcf-437b-a8e5-77e95b66185e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422833898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d405b224d90942d6bd3188f6df34dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853c2c-b0", "ovs_interfaceid": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Releasing lock "refresh_cache-1621d261-aa12-4e57-a74e-fe565d921320" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Instance network_info: |[{"id": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "address": "fa:16:3e:5f:1e:f8", "network": {"id": "637cf6bb-6dcf-437b-a8e5-77e95b66185e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422833898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d405b224d90942d6bd3188f6df34dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853c2c-b0", "ovs_interfaceid": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Start _get_guest_xml network_info=[{"id": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "address": "fa:16:3e:5f:1e:f8", "network": {"id": "637cf6bb-6dcf-437b-a8e5-77e95b66185e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422833898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d405b224d90942d6bd3188f6df34dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853c2c-b0", "ovs_interfaceid": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:44:22 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:44:22 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1100572401',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1100572401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1100572',id=20,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtjhRUFyVPRH/e/ktH+mUsT1uO8ko2e4zGpDkkSEbxU6DaxcHLjUIgjXct8lrxKqC5g0YUiPq+XEX5X+xsUjwv/NWvCIaFRqg5VQp0ow+hJ88U5WsF3bdOXYXptxvOtnw==',key_name='tempest-keypair-1594438920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d405b224d90942d6bd3188f6df34dcd1',ramdisk_id='',reservation_id='r-1zsxveir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1900025064',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f385e70b9fe4413b9870116e2367547',uuid=1621d261-aa12-4e57-a74e-fe565d921320,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "address": "fa:16:3e:5f:1e:f8", "network": {"id": "637cf6bb-6dcf-437b-a8e5-77e95b66185e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422833898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d405b224d90942d6bd3188f6df34dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853c2c-b0", "ovs_interfaceid": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Converting VIF {"id": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "address": "fa:16:3e:5f:1e:f8", "network": {"id": "637cf6bb-6dcf-437b-a8e5-77e95b66185e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422833898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d405b224d90942d6bd3188f6df34dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853c2c-b0", "ovs_interfaceid": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1e:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b853c2c-b02a-49c8-a6a4-76106e6b2228,network=Network(637cf6bb-6dcf-437b-a8e5-77e95b66185e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853c2c-b0') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.objects.instance [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lazy-loading 'pci_devices' on Instance uuid 1621d261-aa12-4e57-a74e-fe565d921320 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:44:22 user nova-compute[75826]:   <uuid>1621d261-aa12-4e57-a74e-fe565d921320</uuid>
Nov 16 00:44:22 user nova-compute[75826]:   <name>instance-00000014</name>
Nov 16 00:44:22 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:44:22 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:44:22 user nova-compute[75826]:   <metadata>
Nov 16 00:44:22 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:44:22 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:44:22 user nova-compute[75826]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1100572401</nova:name>
Nov 16 00:44:22 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:44:22</nova:creationTime>
Nov 16 00:44:22 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:44:22 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:44:22 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:44:22 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:44:22 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:44:22 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:44:22 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:44:22 user nova-compute[75826]:       <nova:owner>
Nov 16 00:44:22 user nova-compute[75826]:         <nova:user uuid="5f385e70b9fe4413b9870116e2367547">tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member</nova:user>
Nov 16 00:44:22 user nova-compute[75826]:         <nova:project uuid="d405b224d90942d6bd3188f6df34dcd1">tempest-TestServerVolumeAttachScenarioOldVersion-1900025064</nova:project>
Nov 16 00:44:22 user nova-compute[75826]:       </nova:owner>
Nov 16 00:44:22 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:44:22 user nova-compute[75826]:       <nova:ports>
Nov 16 00:44:22 user nova-compute[75826]:         <nova:port uuid="8b853c2c-b02a-49c8-a6a4-76106e6b2228">
Nov 16 00:44:22 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 00:44:22 user nova-compute[75826]:         </nova:port>
Nov 16 00:44:22 user nova-compute[75826]:       </nova:ports>
Nov 16 00:44:22 user nova-compute[75826]:     </nova:instance>
Nov 16 00:44:22 user nova-compute[75826]:   </metadata>
Nov 16 00:44:22 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:44:22 user nova-compute[75826]:     <system>
Nov 16 00:44:22 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:44:22 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:44:22 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:44:22 user nova-compute[75826]:       <entry name="serial">1621d261-aa12-4e57-a74e-fe565d921320</entry>
Nov 16 00:44:22 user nova-compute[75826]:       <entry name="uuid">1621d261-aa12-4e57-a74e-fe565d921320</entry>
Nov 16 00:44:22 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:44:22 user nova-compute[75826]:     </system>
Nov 16 00:44:22 user nova-compute[75826]:   </sysinfo>
Nov 16 00:44:22 user nova-compute[75826]:   <os>
Nov 16 00:44:22 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:44:22 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:44:22 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:44:22 user nova-compute[75826]:   </os>
Nov 16 00:44:22 user nova-compute[75826]:   <features>
Nov 16 00:44:22 user nova-compute[75826]:     <acpi/>
Nov 16 00:44:22 user nova-compute[75826]:     <apic/>
Nov 16 00:44:22 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:44:22 user nova-compute[75826]:   </features>
Nov 16 00:44:22 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:44:22 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:44:22 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:44:22 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:44:22 user nova-compute[75826]:   </clock>
Nov 16 00:44:22 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:44:22 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:44:22 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:44:22 user nova-compute[75826]:   </cpu>
Nov 16 00:44:22 user nova-compute[75826]:   <devices>
Nov 16 00:44:22 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:44:22 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:44:22 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk"/>
Nov 16 00:44:22 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:44:22 user nova-compute[75826]:     </disk>
Nov 16 00:44:22 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:44:22 user nova-compute[75826]:       <mac address="fa:16:3e:5f:1e:f8"/>
Nov 16 00:44:22 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:44:22 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:44:22 user nova-compute[75826]:       <target dev="tap8b853c2c-b0"/>
Nov 16 00:44:22 user nova-compute[75826]:     </interface>
Nov 16 00:44:22 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:44:22 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/console.log" append="off"/>
Nov 16 00:44:22 user nova-compute[75826]:     </serial>
Nov 16 00:44:22 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:44:22 user nova-compute[75826]:     <video>
Nov 16 00:44:22 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:44:22 user nova-compute[75826]:     </video>
Nov 16 00:44:22 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:44:22 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:44:22 user nova-compute[75826]:     </rng>
Nov 16 00:44:22 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:44:22 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:44:22 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:44:22 user nova-compute[75826]:     </memballoon>
Nov 16 00:44:22 user nova-compute[75826]:   </devices>
Nov 16 00:44:22 user nova-compute[75826]: </domain>
Nov 16 00:44:22 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1100572401',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1100572401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1100572',id=20,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtjhRUFyVPRH/e/ktH+mUsT1uO8ko2e4zGpDkkSEbxU6DaxcHLjUIgjXct8lrxKqC5g0YUiPq+XEX5X+xsUjwv/NWvCIaFRqg5VQp0ow+hJ88U5WsF3bdOXYXptxvOtnw==',key_name='tempest-keypair-1594438920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d405b224d90942d6bd3188f6df34dcd1',ramdisk_id='',reservation_id='r-1zsxveir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1900025064',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f385e70b9fe4413b9870116e2367547',uuid=1621d261-aa12-4e57-a74e-fe565d921320,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "address": "fa:16:3e:5f:1e:f8", "network": {"id": "637cf6bb-6dcf-437b-a8e5-77e95b66185e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422833898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d405b224d90942d6bd3188f6df34dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853c2c-b0", "ovs_interfaceid": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Converting VIF {"id": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "address": "fa:16:3e:5f:1e:f8", "network": {"id": "637cf6bb-6dcf-437b-a8e5-77e95b66185e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422833898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d405b224d90942d6bd3188f6df34dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853c2c-b0", "ovs_interfaceid": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1e:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b853c2c-b02a-49c8-a6a4-76106e6b2228,network=Network(637cf6bb-6dcf-437b-a8e5-77e95b66185e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853c2c-b0') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG os_vif [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1e:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b853c2c-b02a-49c8-a6a4-76106e6b2228,network=Network(637cf6bb-6dcf-437b-a8e5-77e95b66185e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853c2c-b0') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f3c8aba4-8332-55b7-b76c-454085bb2885', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b853c2c-b0, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b853c2c-b0, col_values=(('qos', UUID('72cf2284-cd90-4bd0-b733-b3f9ad8b8c61')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b853c2c-b0, col_values=(('external_ids', {'iface-id': '8b853c2c-b02a-49c8-a6a4-76106e6b2228', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:1e:f8', 'vm-uuid': '1621d261-aa12-4e57-a74e-fe565d921320'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:22 user nova-compute[75826]: INFO os_vif [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:1e:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b853c2c-b02a-49c8-a6a4-76106e6b2228,network=Network(637cf6bb-6dcf-437b-a8e5-77e95b66185e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853c2c-b0')
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.compute.manager [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:44:22 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Instance spawned successfully.
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] No VIF found with MAC fa:16:3e:5f:1e:f8, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:22 user nova-compute[75826]: INFO nova.compute.manager [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Took 7.71 seconds to spawn the instance on the hypervisor.
Nov 16 00:44:22 user nova-compute[75826]: DEBUG nova.compute.manager [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:44:22 user nova-compute[75826]: INFO nova.compute.manager [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Took 8.92 seconds to build instance.
Nov 16 00:44:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-42bb9c79-dad9-4870-9eac-b2b7af6a0ed5 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.060s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Received event network-vif-plugged-b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] Acquiring lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] Lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] Lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] No waiting events found dispatching network-vif-plugged-b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:23 user nova-compute[75826]: WARNING nova.compute.manager [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Received unexpected event network-vif-plugged-b5701d2a-63a8-4968-bec1-7aa295b81b60 for instance with vm_state active and task_state None.
Nov 16 00:44:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Received event network-changed-8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Refreshing instance network info cache due to event network-changed-8b853c2c-b02a-49c8-a6a4-76106e6b2228. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:44:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] Acquiring lock "refresh_cache-1621d261-aa12-4e57-a74e-fe565d921320" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] Acquired lock "refresh_cache-1621d261-aa12-4e57-a74e-fe565d921320" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:23 user nova-compute[75826]: DEBUG nova.network.neutron [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Refreshing network info cache for port 8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:44:23 user nova-compute[75826]: DEBUG nova.network.neutron [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Updated VIF entry in instance network info cache for port 8b853c2c-b02a-49c8-a6a4-76106e6b2228. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:44:23 user nova-compute[75826]: DEBUG nova.network.neutron [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Updating instance_info_cache with network_info: [{"id": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "address": "fa:16:3e:5f:1e:f8", "network": {"id": "637cf6bb-6dcf-437b-a8e5-77e95b66185e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422833898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d405b224d90942d6bd3188f6df34dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853c2c-b0", "ovs_interfaceid": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5dfd1bcf-ce36-47e8-ae88-011683c41bb1 req-0e883329-72d2-4559-b917-84715dacef1f service nova] Releasing lock "refresh_cache-1621d261-aa12-4e57-a74e-fe565d921320" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-fdaa59d8-1b14-4b46-80b1-b9b6e2929f71 req-24ae8d8b-b15d-4985-a9d8-0c2bf2719b51 service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Received event network-vif-plugged-8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fdaa59d8-1b14-4b46-80b1-b9b6e2929f71 req-24ae8d8b-b15d-4985-a9d8-0c2bf2719b51 service nova] Acquiring lock "1621d261-aa12-4e57-a74e-fe565d921320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fdaa59d8-1b14-4b46-80b1-b9b6e2929f71 req-24ae8d8b-b15d-4985-a9d8-0c2bf2719b51 service nova] Lock "1621d261-aa12-4e57-a74e-fe565d921320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fdaa59d8-1b14-4b46-80b1-b9b6e2929f71 req-24ae8d8b-b15d-4985-a9d8-0c2bf2719b51 service nova] Lock "1621d261-aa12-4e57-a74e-fe565d921320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-fdaa59d8-1b14-4b46-80b1-b9b6e2929f71 req-24ae8d8b-b15d-4985-a9d8-0c2bf2719b51 service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] No waiting events found dispatching network-vif-plugged-8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:25 user nova-compute[75826]: WARNING nova.compute.manager [req-fdaa59d8-1b14-4b46-80b1-b9b6e2929f71 req-24ae8d8b-b15d-4985-a9d8-0c2bf2719b51 service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Received unexpected event network-vif-plugged-8b853c2c-b02a-49c8-a6a4-76106e6b2228 for instance with vm_state building and task_state spawning.
Nov 16 00:44:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:44:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:44:26 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Instance spawned successfully.
Nov 16 00:44:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:44:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:26 user nova-compute[75826]: INFO nova.compute.manager [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 16 00:44:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:44:26 user nova-compute[75826]: INFO nova.compute.manager [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Took 7.40 seconds to build instance.
Nov 16 00:44:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bae4177d-c6a6-49bc-95a7-15df7bf899be tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "1621d261-aa12-4e57-a74e-fe565d921320" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.521s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-c88af222-9376-4bd4-813d-2ae0cef4e41c req-47faf18e-ca3a-4a5d-b882-a214ecfa35fa service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Received event network-vif-plugged-8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c88af222-9376-4bd4-813d-2ae0cef4e41c req-47faf18e-ca3a-4a5d-b882-a214ecfa35fa service nova] Acquiring lock "1621d261-aa12-4e57-a74e-fe565d921320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c88af222-9376-4bd4-813d-2ae0cef4e41c req-47faf18e-ca3a-4a5d-b882-a214ecfa35fa service nova] Lock "1621d261-aa12-4e57-a74e-fe565d921320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c88af222-9376-4bd4-813d-2ae0cef4e41c req-47faf18e-ca3a-4a5d-b882-a214ecfa35fa service nova] Lock "1621d261-aa12-4e57-a74e-fe565d921320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-c88af222-9376-4bd4-813d-2ae0cef4e41c req-47faf18e-ca3a-4a5d-b882-a214ecfa35fa service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] No waiting events found dispatching network-vif-plugged-8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:27 user nova-compute[75826]: WARNING nova.compute.manager [req-c88af222-9376-4bd4-813d-2ae0cef4e41c req-47faf18e-ca3a-4a5d-b882-a214ecfa35fa service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Received unexpected event network-vif-plugged-8b853c2c-b02a-49c8-a6a4-76106e6b2228 for instance with vm_state active and task_state None.
Nov 16 00:44:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:44:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:39 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:44:39 user nova-compute[75826]: INFO nova.compute.claims [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Claim successful on node user
Nov 16 00:44:40 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:44:40 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:44:40 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:44:40 user nova-compute[75826]: INFO nova.virt.block_device [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Booting with volume 9ae16302-65c4-4d3a-b525-4e1c7260ed1a at /dev/vda
Nov 16 00:44:40 user nova-compute[75826]: DEBUG nova.policy [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '38b40689c2324d48bdf1f8ec8d4dc573', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '02b8f62ebb8e4b4c9586b1092aabec74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG os_brick.utils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3541395-5196-4907-a275-581c092281e9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd937cb-e591-49a0-b998-041a6db8d117]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec96882-a2d4-478d-9409-2bfa54a70fe7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8b8cb7-8f0a-42c3-8a91-e8771e20290d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:44:40 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:44:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[60db5e63-9451-4881-a1c7-c254021c777b]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG os_brick.utils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:44:40 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating existing volume attachment record: ad13d6d3-556d-46fe-af5d-d8b2fea01c39 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:44:41 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Successfully created port: 950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:44:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-3bbbbb37-8ec4-4a09-b25e-5b89a2d50123 req-ea6914a9-2db2-4a3d-9525-665016e6c62c service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-changed-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-3bbbbb37-8ec4-4a09-b25e-5b89a2d50123 req-ea6914a9-2db2-4a3d-9525-665016e6c62c service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Refreshing instance network info cache due to event network-changed-850f4dad-cf10-4839-a39f-16868c918dee. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:44:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3bbbbb37-8ec4-4a09-b25e-5b89a2d50123 req-ea6914a9-2db2-4a3d-9525-665016e6c62c service nova] Acquiring lock "refresh_cache-4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3bbbbb37-8ec4-4a09-b25e-5b89a2d50123 req-ea6914a9-2db2-4a3d-9525-665016e6c62c service nova] Acquired lock "refresh_cache-4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-3bbbbb37-8ec4-4a09-b25e-5b89a2d50123 req-ea6914a9-2db2-4a3d-9525-665016e6c62c service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Refreshing network info cache for port 850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Successfully created port: 3753c6de-ba1a-4839-81db-e9920a6b815f {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG nova.network.neutron [req-3bbbbb37-8ec4-4a09-b25e-5b89a2d50123 req-ea6914a9-2db2-4a3d-9525-665016e6c62c service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Updated VIF entry in instance network info cache for port 850f4dad-cf10-4839-a39f-16868c918dee. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG nova.network.neutron [req-3bbbbb37-8ec4-4a09-b25e-5b89a2d50123 req-ea6914a9-2db2-4a3d-9525-665016e6c62c service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Updating instance_info_cache with network_info: [{"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lazy-loading 'flavor' on Instance uuid 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3bbbbb37-8ec4-4a09-b25e-5b89a2d50123 req-ea6914a9-2db2-4a3d-9525-665016e6c62c service nova] Releasing lock "refresh_cache-4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:42 user nova-compute[75826]: INFO nova.compute.manager [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Attaching volume 88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 to /dev/vdb
Nov 16 00:44:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Successfully created port: 5f1e8fd9-8c1e-4815-9320-fe039c91101f {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG os_brick.utils [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8754ecf-bcbb-44ba-bb98-a0acb82d371f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f4e9a1-9394-482e-9027-127fb1bd1989]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[29877678-bf11-4633-9f22-b3331760f3ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[17372e7b-43ae-43da-a876-f3628b24783d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:44:42 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:44:42 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a797d5-470e-4a55-941e-7b393102ca01]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG os_brick.utils [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:44:42 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Updating existing volume attachment record: aa965c4c-c8e2-4aa6-a099-7c40a45ddd29 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:44:43 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Successfully created port: d9656c82-57df-4891-9c78-531de3f2c5aa {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:44:43 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Successfully created port: 605e5626-2a1e-4c78-8781-6bfd370354af {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:44:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:44 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Successfully updated port: 950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:44:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-810f83f4-99a5-404b-8f75-44a6aff4739a req-fb6b366e-dccf-4fe5-8f6a-b742aa683221 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-changed-950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-810f83f4-99a5-404b-8f75-44a6aff4739a req-fb6b366e-dccf-4fe5-8f6a-b742aa683221 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing instance network info cache due to event network-changed-950ac11c-60e7-4772-ab1f-51235827d355. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:44:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-810f83f4-99a5-404b-8f75-44a6aff4739a req-fb6b366e-dccf-4fe5-8f6a-b742aa683221 service nova] Acquiring lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-810f83f4-99a5-404b-8f75-44a6aff4739a req-fb6b366e-dccf-4fe5-8f6a-b742aa683221 service nova] Acquired lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-810f83f4-99a5-404b-8f75-44a6aff4739a req-fb6b366e-dccf-4fe5-8f6a-b742aa683221 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing network info cache for port 950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:44:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-810f83f4-99a5-404b-8f75-44a6aff4739a req-fb6b366e-dccf-4fe5-8f6a-b742aa683221 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:44:45 user nova-compute[75826]: DEBUG nova.network.neutron [req-810f83f4-99a5-404b-8f75-44a6aff4739a req-fb6b366e-dccf-4fe5-8f6a-b742aa683221 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-810f83f4-99a5-404b-8f75-44a6aff4739a req-fb6b366e-dccf-4fe5-8f6a-b742aa683221 service nova] Releasing lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:45 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Successfully updated port: 44813b22-4904-4534-9674-14220b2ee743 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Successfully updated port: 09a45f64-c713-4faf-b030-9a71edc2bfe5 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:44:46 user nova-compute[75826]: INFO nova.virt.block_device [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Booting with volume 2c135a70-4e99-4e05-bce1-847f292dcbd3 at /dev/vdb
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5be68126-c125-441d-8f82-4c474b7ce768" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG os_brick.utils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e800c3-173c-47dc-8789-e17d5b202045]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ef33db-b156-45d5-96b5-1d48d4dd0425]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52a807b-b114-4b25-ab23-0d06afe130a4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0aa2f2-d7b7-4619-891d-10886ff9ddca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:44:46 user nova-compute[75826]: INFO nova.compute.claims [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Claim successful on node user
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:44:46 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa28955-baa2-4e69-871e-c18d3cf6cbec]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG os_brick.utils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating existing volume attachment record: 58746261-5ec7-445d-8703-e5b1281ddaa3 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-changed-44813b22-4904-4534-9674-14220b2ee743 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing instance network info cache due to event network-changed-44813b22-4904-4534-9674-14220b2ee743. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] Acquiring lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] Acquired lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.network.neutron [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing network info cache for port 44813b22-4904-4534-9674-14220b2ee743 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.network.neutron [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.network.neutron [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:44:46 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:44:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.policy [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca3f8ab341484fc6ae7176cd66e18e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6b9da552fd49509a93b461cceb15ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.network.neutron [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.compute.manager [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:44:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Creating image(s)
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "/opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "/opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "/opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] Releasing lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-changed-09a45f64-c713-4faf-b030-9a71edc2bfe5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing instance network info cache due to event network-changed-09a45f64-c713-4faf-b030-9a71edc2bfe5. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] Acquiring lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] Acquired lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.network.neutron [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing network info cache for port 09a45f64-c713-4faf-b030-9a71edc2bfe5 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Successfully updated port: 3753c6de-ba1a-4839-81db-e9920a6b815f {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.network.neutron [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.201s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.network.neutron [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk 1073741824" returned: 0 in 0.058s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f1c91f0f-fcb5-4f18-a0bd-ecab53abe305 req-3abaeaf7-9968-437a-aee7-2d79c9721fdd service nova] Releasing lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTGQcYvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:44:47 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:44:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:44:47 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:44:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:44:47 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cfc3ff-8168-4c2c-af21-f0e25b4fc2d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:44:47 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d582052-6771-4b8f-8f8c-22a14fc79df0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087] added
Nov 16 00:44:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[014e717a-8430-4c56-949a-1765a4857f9c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5171a14e-9b1d-44f2-9455-7a81832be602]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fTGQcYvd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fTGQcYvd" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce063ce0-9ff2-40d3-b6df-3fb373b3ca92]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fTGQcYvd'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Cannot resize image /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Ensure instance console log exists: /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4f086b-7ccb-4fbd-b0dc-4f81c0c4a9e5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[455380fd-104a-459e-bc6b-0de0c708e9a7]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:47 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:44:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:47 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:44:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:44:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[385deae7-c022-4360-9bbc-57630a1e1891]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260]
Nov 16 00:44:48 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260] successful.
Nov 16 00:44:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fbc4b5-fd28-459e-855b-6fa32483de3a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a2c226-b05b-4477-b27f-f75124498562]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:48 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:44:48 user nova-compute[75826]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:44:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:48 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:44:48 user nova-compute[75826]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:44:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG nova.network.neutron [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Successfully created port: bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a09c92e-30fb-4c95-8bb5-98bd3c87cbe3]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTGQcYvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Successfully updated port: 5f1e8fd9-8c1e-4815-9320-fe039c91101f {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-4254c395-0d35-42f9-9b30-36165646183f req-de42d51c-7bc6-4004-86b8-c32a81ffc7d3 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-changed-5f1e8fd9-8c1e-4815-9320-fe039c91101f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-4254c395-0d35-42f9-9b30-36165646183f req-de42d51c-7bc6-4004-86b8-c32a81ffc7d3 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing instance network info cache due to event network-changed-5f1e8fd9-8c1e-4815-9320-fe039c91101f. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4254c395-0d35-42f9-9b30-36165646183f req-de42d51c-7bc6-4004-86b8-c32a81ffc7d3 service nova] Acquiring lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4254c395-0d35-42f9-9b30-36165646183f req-de42d51c-7bc6-4004-86b8-c32a81ffc7d3 service nova] Acquired lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-4254c395-0d35-42f9-9b30-36165646183f req-de42d51c-7bc6-4004-86b8-c32a81ffc7d3 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing network info cache for port 5f1e8fd9-8c1e-4815-9320-fe039c91101f {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-4254c395-0d35-42f9-9b30-36165646183f req-de42d51c-7bc6-4004-86b8-c32a81ffc7d3 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-fdf98163-a0ec-4393-96c7-c47225a8ba1e req-5c1e25c1-2448-4035-bb40-11aa758f6330 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-changed-3753c6de-ba1a-4839-81db-e9920a6b815f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-fdf98163-a0ec-4393-96c7-c47225a8ba1e req-5c1e25c1-2448-4035-bb40-11aa758f6330 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing instance network info cache due to event network-changed-3753c6de-ba1a-4839-81db-e9920a6b815f. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fdf98163-a0ec-4393-96c7-c47225a8ba1e req-5c1e25c1-2448-4035-bb40-11aa758f6330 service nova] Acquiring lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-4254c395-0d35-42f9-9b30-36165646183f req-de42d51c-7bc6-4004-86b8-c32a81ffc7d3 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4254c395-0d35-42f9-9b30-36165646183f req-de42d51c-7bc6-4004-86b8-c32a81ffc7d3 service nova] Releasing lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fdf98163-a0ec-4393-96c7-c47225a8ba1e req-5c1e25c1-2448-4035-bb40-11aa758f6330 service nova] Acquired lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-fdf98163-a0ec-4393-96c7-c47225a8ba1e req-5c1e25c1-2448-4035-bb40-11aa758f6330 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing network info cache for port 3753c6de-ba1a-4839-81db-e9920a6b815f {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:44:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-fdf98163-a0ec-4393-96c7-c47225a8ba1e req-5c1e25c1-2448-4035-bb40-11aa758f6330 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG nova.network.neutron [req-fdf98163-a0ec-4393-96c7-c47225a8ba1e req-5c1e25c1-2448-4035-bb40-11aa758f6330 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23234613239616261', 'path': '/dev/sdd'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234613239616261', 'path': '/dev/sdd'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lazy-loading 'flavor' on Instance uuid 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fdf98163-a0ec-4393-96c7-c47225a8ba1e req-5c1e25c1-2448-4035-bb40-11aa758f6330 service nova] Releasing lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:44:49 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:44:49 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 00:44:49 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:44:49 user nova-compute[75826]:   <serial>88fa2ef5-c0dd-4acb-8376-9e74e9e0c087</serial>
Nov 16 00:44:49 user nova-compute[75826]: </disk>
Nov 16 00:44:49 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No VIF found with MAC fa:16:3e:7c:72:81, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG nova.network.neutron [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Successfully updated port: bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "refresh_cache-5be68126-c125-441d-8f82-4c474b7ce768" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquired lock "refresh_cache-5be68126-c125-441d-8f82-4c474b7ce768" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG nova.network.neutron [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d06ae80e-1772-42d3-bfb9-4b2b23514a90 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.295s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG nova.network.neutron [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:44:49 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Successfully updated port: d9656c82-57df-4891-9c78-531de3f2c5aa {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.network.neutron [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Updating instance_info_cache with network_info: [{"id": "bfa57e78-a3df-44e1-9268-e37a5d006931", "address": "fa:16:3e:d9:35:e0", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa57e78-a3", "ovs_interfaceid": "bfa57e78-a3df-44e1-9268-e37a5d006931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Releasing lock "refresh_cache-5be68126-c125-441d-8f82-4c474b7ce768" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Instance network_info: |[{"id": "bfa57e78-a3df-44e1-9268-e37a5d006931", "address": "fa:16:3e:d9:35:e0", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa57e78-a3", "ovs_interfaceid": "bfa57e78-a3df-44e1-9268-e37a5d006931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Start _get_guest_xml network_info=[{"id": "bfa57e78-a3df-44e1-9268-e37a5d006931", "address": "fa:16:3e:d9:35:e0", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa57e78-a3", "ovs_interfaceid": "bfa57e78-a3df-44e1-9268-e37a5d006931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:44:50 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:44:50 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-240075061',display_name='tempest-VolumesSnapshotTestJSON-instance-240075061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-240075061',id=22,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQe1Ki3X9ZchL/WXY0JGe/bgwWt2WwFqCr3DF0WYj7QWSm5uAYqsrQmYmnkbpKHdghMtjLeKyVHdpaZRbTAvFnH808h7vkO6JxmV32R5PXU4sxrQahpyJcMQKFnBF5odw==',key_name='tempest-keypair-761531832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d6b9da552fd49509a93b461cceb15ad',ramdisk_id='',reservation_id='r-frxgt8to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1407250662',owner_user_name='tempest-VolumesSnapshotTestJSON-1407250662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca3f8ab341484fc6ae7176cd66e18e7b',uuid=5be68126-c125-441d-8f82-4c474b7ce768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfa57e78-a3df-44e1-9268-e37a5d006931", "address": "fa:16:3e:d9:35:e0", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa57e78-a3", "ovs_interfaceid": "bfa57e78-a3df-44e1-9268-e37a5d006931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Converting VIF {"id": "bfa57e78-a3df-44e1-9268-e37a5d006931", "address": "fa:16:3e:d9:35:e0", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa57e78-a3", "ovs_interfaceid": "bfa57e78-a3df-44e1-9268-e37a5d006931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:35:e0,bridge_name='br-int',has_traffic_filtering=True,id=bfa57e78-a3df-44e1-9268-e37a5d006931,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa57e78-a3') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.objects.instance [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lazy-loading 'pci_devices' on Instance uuid 5be68126-c125-441d-8f82-4c474b7ce768 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:44:50 user nova-compute[75826]:   <uuid>5be68126-c125-441d-8f82-4c474b7ce768</uuid>
Nov 16 00:44:50 user nova-compute[75826]:   <name>instance-00000016</name>
Nov 16 00:44:50 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:44:50 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:44:50 user nova-compute[75826]:   <metadata>
Nov 16 00:44:50 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:44:50 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:44:50 user nova-compute[75826]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-240075061</nova:name>
Nov 16 00:44:50 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:44:50</nova:creationTime>
Nov 16 00:44:50 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:44:50 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:44:50 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:44:50 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:44:50 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:44:50 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:44:50 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:44:50 user nova-compute[75826]:       <nova:owner>
Nov 16 00:44:50 user nova-compute[75826]:         <nova:user uuid="ca3f8ab341484fc6ae7176cd66e18e7b">tempest-VolumesSnapshotTestJSON-1407250662-project-member</nova:user>
Nov 16 00:44:50 user nova-compute[75826]:         <nova:project uuid="7d6b9da552fd49509a93b461cceb15ad">tempest-VolumesSnapshotTestJSON-1407250662</nova:project>
Nov 16 00:44:50 user nova-compute[75826]:       </nova:owner>
Nov 16 00:44:50 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:44:50 user nova-compute[75826]:       <nova:ports>
Nov 16 00:44:50 user nova-compute[75826]:         <nova:port uuid="bfa57e78-a3df-44e1-9268-e37a5d006931">
Nov 16 00:44:50 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 00:44:50 user nova-compute[75826]:         </nova:port>
Nov 16 00:44:50 user nova-compute[75826]:       </nova:ports>
Nov 16 00:44:50 user nova-compute[75826]:     </nova:instance>
Nov 16 00:44:50 user nova-compute[75826]:   </metadata>
Nov 16 00:44:50 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:44:50 user nova-compute[75826]:     <system>
Nov 16 00:44:50 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:44:50 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:44:50 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:44:50 user nova-compute[75826]:       <entry name="serial">5be68126-c125-441d-8f82-4c474b7ce768</entry>
Nov 16 00:44:50 user nova-compute[75826]:       <entry name="uuid">5be68126-c125-441d-8f82-4c474b7ce768</entry>
Nov 16 00:44:50 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:44:50 user nova-compute[75826]:     </system>
Nov 16 00:44:50 user nova-compute[75826]:   </sysinfo>
Nov 16 00:44:50 user nova-compute[75826]:   <os>
Nov 16 00:44:50 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:44:50 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:44:50 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:44:50 user nova-compute[75826]:   </os>
Nov 16 00:44:50 user nova-compute[75826]:   <features>
Nov 16 00:44:50 user nova-compute[75826]:     <acpi/>
Nov 16 00:44:50 user nova-compute[75826]:     <apic/>
Nov 16 00:44:50 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:44:50 user nova-compute[75826]:   </features>
Nov 16 00:44:50 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:44:50 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:44:50 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:44:50 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:44:50 user nova-compute[75826]:   </clock>
Nov 16 00:44:50 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:44:50 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:44:50 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:44:50 user nova-compute[75826]:   </cpu>
Nov 16 00:44:50 user nova-compute[75826]:   <devices>
Nov 16 00:44:50 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:44:50 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:44:50 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk"/>
Nov 16 00:44:50 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:44:50 user nova-compute[75826]:     </disk>
Nov 16 00:44:50 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:44:50 user nova-compute[75826]:       <mac address="fa:16:3e:d9:35:e0"/>
Nov 16 00:44:50 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:44:50 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:44:50 user nova-compute[75826]:       <target dev="tapbfa57e78-a3"/>
Nov 16 00:44:50 user nova-compute[75826]:     </interface>
Nov 16 00:44:50 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:44:50 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/console.log" append="off"/>
Nov 16 00:44:50 user nova-compute[75826]:     </serial>
Nov 16 00:44:50 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:44:50 user nova-compute[75826]:     <video>
Nov 16 00:44:50 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:44:50 user nova-compute[75826]:     </video>
Nov 16 00:44:50 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:44:50 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:44:50 user nova-compute[75826]:     </rng>
Nov 16 00:44:50 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:44:50 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:44:50 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:44:50 user nova-compute[75826]:     </memballoon>
Nov 16 00:44:50 user nova-compute[75826]:   </devices>
Nov 16 00:44:50 user nova-compute[75826]: </domain>
Nov 16 00:44:50 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-240075061',display_name='tempest-VolumesSnapshotTestJSON-instance-240075061',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-240075061',id=22,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQe1Ki3X9ZchL/WXY0JGe/bgwWt2WwFqCr3DF0WYj7QWSm5uAYqsrQmYmnkbpKHdghMtjLeKyVHdpaZRbTAvFnH808h7vkO6JxmV32R5PXU4sxrQahpyJcMQKFnBF5odw==',key_name='tempest-keypair-761531832',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d6b9da552fd49509a93b461cceb15ad',ramdisk_id='',reservation_id='r-frxgt8to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1407250662',owner_user_name='tempest-VolumesSnapshotTestJSON-1407250662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca3f8ab341484fc6ae7176cd66e18e7b',uuid=5be68126-c125-441d-8f82-4c474b7ce768,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfa57e78-a3df-44e1-9268-e37a5d006931", "address": "fa:16:3e:d9:35:e0", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa57e78-a3", "ovs_interfaceid": "bfa57e78-a3df-44e1-9268-e37a5d006931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Converting VIF {"id": "bfa57e78-a3df-44e1-9268-e37a5d006931", "address": "fa:16:3e:d9:35:e0", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa57e78-a3", "ovs_interfaceid": "bfa57e78-a3df-44e1-9268-e37a5d006931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:35:e0,bridge_name='br-int',has_traffic_filtering=True,id=bfa57e78-a3df-44e1-9268-e37a5d006931,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa57e78-a3') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG os_vif [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:35:e0,bridge_name='br-int',has_traffic_filtering=True,id=bfa57e78-a3df-44e1-9268-e37a5d006931,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa57e78-a3') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76b7eb58-0b77-5f14-b586-84d9960e62a2', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfa57e78-a3, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfa57e78-a3, col_values=(('qos', UUID('1d274680-1a64-438a-9bbb-163498142d15')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfa57e78-a3, col_values=(('external_ids', {'iface-id': 'bfa57e78-a3df-44e1-9268-e37a5d006931', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:35:e0', 'vm-uuid': '5be68126-c125-441d-8f82-4c474b7ce768'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:50 user nova-compute[75826]: INFO os_vif [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:35:e0,bridge_name='br-int',has_traffic_filtering=True,id=bfa57e78-a3df-44e1-9268-e37a5d006931,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa57e78-a3')
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] No VIF found with MAC fa:16:3e:d9:35:e0, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received event network-changed-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Refreshing instance network info cache due to event network-changed-bfa57e78-a3df-44e1-9268-e37a5d006931. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] Acquiring lock "refresh_cache-5be68126-c125-441d-8f82-4c474b7ce768" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] Acquired lock "refresh_cache-5be68126-c125-441d-8f82-4c474b7ce768" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.network.neutron [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Refreshing network info cache for port bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:44:50 user nova-compute[75826]: INFO nova.compute.manager [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Rebuilding instance
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Successfully updated port: 605e5626-2a1e-4c78-8781-6bfd370354af {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquired lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:50 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-dcf295e3-a65c-4d8a-b241-da0c9456361e req-a914c2c3-3244-4fb7-8b75-a66708975004 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-unplugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dcf295e3-a65c-4d8a-b241-da0c9456361e req-a914c2c3-3244-4fb7-8b75-a66708975004 service nova] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dcf295e3-a65c-4d8a-b241-da0c9456361e req-a914c2c3-3244-4fb7-8b75-a66708975004 service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dcf295e3-a65c-4d8a-b241-da0c9456361e req-a914c2c3-3244-4fb7-8b75-a66708975004 service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-dcf295e3-a65c-4d8a-b241-da0c9456361e req-a914c2c3-3244-4fb7-8b75-a66708975004 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] No waiting events found dispatching network-vif-unplugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:51 user nova-compute[75826]: WARNING nova.compute.manager [req-dcf295e3-a65c-4d8a-b241-da0c9456361e req-a914c2c3-3244-4fb7-8b75-a66708975004 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received unexpected event network-vif-unplugged-850f4dad-cf10-4839-a39f-16868c918dee for instance with vm_state active and task_state rebuilding.
Nov 16 00:44:51 user nova-compute[75826]: DEBUG nova.network.neutron [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Updated VIF entry in instance network info cache for port bfa57e78-a3df-44e1-9268-e37a5d006931. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG nova.network.neutron [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Updating instance_info_cache with network_info: [{"id": "bfa57e78-a3df-44e1-9268-e37a5d006931", "address": "fa:16:3e:d9:35:e0", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa57e78-a3", "ovs_interfaceid": "bfa57e78-a3df-44e1-9268-e37a5d006931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] Releasing lock "refresh_cache-5be68126-c125-441d-8f82-4c474b7ce768" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-changed-d9656c82-57df-4891-9c78-531de3f2c5aa {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing instance network info cache due to event network-changed-d9656c82-57df-4891-9c78-531de3f2c5aa. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] Acquiring lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:51 user nova-compute[75826]: INFO nova.virt.block_device [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Booting with volume 0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a at /dev/vdc
Nov 16 00:44:51 user nova-compute[75826]: DEBUG os_brick.utils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3568143-c540-480e-be49-edf522e55c93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ceac87-383a-4373-9958-043e500f3743]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4a9427-bd63-4178-886e-f60c19437da8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d004c2-8a54-47a5-89d9-2338b4f8ed5d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:44:51 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:44:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e80a002-f161-459d-898b-eb5084a46aa8]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG os_brick.utils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:44:51 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating existing volume attachment record: 90a592c3-60e4-46a9-9661-1b69a435e682 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:52 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Instance destroyed successfully.
Nov 16 00:44:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:52 user nova-compute[75826]: INFO nova.compute.manager [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Detaching volume 88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:44:52 user nova-compute[75826]: INFO nova.virt.block_device [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Attempting to driver detach volume 88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 from mountpoint /dev/vdb
Nov 16 00:44:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Attempting to detach device vdb from instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:44:52 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:44:52 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 00:44:52 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:44:52 user nova-compute[75826]:   <serial>88fa2ef5-c0dd-4acb-8376-9e74e9e0c087</serial>
Nov 16 00:44:52 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:44:52 user nova-compute[75826]: </disk>
Nov 16 00:44:52 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG nova.compute.manager [req-f3f59296-ca55-4feb-8efe-ea7237ab9f05 req-a795b978-fc95-402e-8f55-ca191dfe153f service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received event network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f3f59296-ca55-4feb-8efe-ea7237ab9f05 req-a795b978-fc95-402e-8f55-ca191dfe153f service nova] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f3f59296-ca55-4feb-8efe-ea7237ab9f05 req-a795b978-fc95-402e-8f55-ca191dfe153f service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f3f59296-ca55-4feb-8efe-ea7237ab9f05 req-a795b978-fc95-402e-8f55-ca191dfe153f service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG nova.compute.manager [req-f3f59296-ca55-4feb-8efe-ea7237ab9f05 req-a795b978-fc95-402e-8f55-ca191dfe153f service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] No waiting events found dispatching network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:52 user nova-compute[75826]: WARNING nova.compute.manager [req-f3f59296-ca55-4feb-8efe-ea7237ab9f05 req-a795b978-fc95-402e-8f55-ca191dfe153f service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received unexpected event network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 for instance with vm_state building and task_state spawning.
Nov 16 00:44:52 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Successfully detached device vdb from instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 from the persistent domain config.
Nov 16 00:44:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTGQcYvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:44:52 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[762ad474-4c34-479c-97c5-95078da33a2b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:44:52 user nova-compute[75826]: No targets found.
Nov 16 00:44:52 user nova-compute[75826]: iSNS:
Nov 16 00:44:52 user nova-compute[75826]: No targets found.
Nov 16 00:44:52 user nova-compute[75826]: STATIC:
Nov 16 00:44:52 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:44:52 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:44:52 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:44:52 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:44:52 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:44:52 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:44:52 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:44:52 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:44:52 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:44:52 user nova-compute[75826]: FIRMWARE:
Nov 16 00:44:52 user nova-compute[75826]: No targets found.
Nov 16 00:44:52 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:44:52 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:44:52 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfee7427-d962-4466-9667-4d713dd5196f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2f9db1-e85c-4899-b31b-3cc38dcb6110]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:52 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:44:52 user nova-compute[75826]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:44:52 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:52 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:44:52 user nova-compute[75826]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:44:52 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd942ad900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087'): ({'sdd'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Removing single pathed devices sdd {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[07392e20-0285-4571-a6b8-fdb8252ca7c9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de8fcd5-81f0-40c1-ac31-00411550c229]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flushing IO for device /dev/sdd {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb28b417-4a28-492f-a321-fb8f92c72c51]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6c8b71-122a-456a-9e59-c8fdb7700573]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d7b84b-4094-4119-8ee0-58a63fc0d3ec]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG nova.compute.manager [req-3cefff0b-5cc7-427d-a48c-dfc871285c78 req-f0c9d990-d36a-414c-9956-faa6d5432704 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-changed-605e5626-2a1e-4c78-8781-6bfd370354af {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG nova.compute.manager [req-3cefff0b-5cc7-427d-a48c-dfc871285c78 req-f0c9d990-d36a-414c-9956-faa6d5432704 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing instance network info cache due to event network-changed-605e5626-2a1e-4c78-8781-6bfd370354af. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3cefff0b-5cc7-427d-a48c-dfc871285c78 req-f0c9d990-d36a-414c-9956-faa6d5432704 service nova] Acquiring lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8038d0-3940-4df8-9ce8-df1a20336e52]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260]
Nov 16 00:44:52 user nova-compute[75826]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260] successful.
Nov 16 00:44:52 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[38785838-c111-47bd-b9df-b75a966a196f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] <== disconnect_volume: return (366ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating instance_info_cache with network_info: [{"id": "950ac11c-60e7-4772-ab1f-51235827d355", "address": "fa:16:3e:9c:63:6f", "network": {"id": "72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-711726094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950ac11c-60", "ovs_interfaceid": "950ac11c-60e7-4772-ab1f-51235827d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3753c6de-ba1a-4839-81db-e9920a6b815f", "address": "fa:16:3e:c1:93:99", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753c6de-ba", "ovs_interfaceid": "3753c6de-ba1a-4839-81db-e9920a6b815f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Releasing lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Instance network_info: |[{"id": "950ac11c-60e7-4772-ab1f-51235827d355", "address": "fa:16:3e:9c:63:6f", "network": {"id": "72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-711726094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950ac11c-60", "ovs_interfaceid": "950ac11c-60e7-4772-ab1f-51235827d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3753c6de-ba1a-4839-81db-e9920a6b815f", "address": "fa:16:3e:c1:93:99", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753c6de-ba", "ovs_interfaceid": "3753c6de-ba1a-4839-81db-e9920a6b815f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] Acquired lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing network info cache for port d9656c82-57df-4891-9c78-531de3f2c5aa {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-a7641efb-c67d-4bae-be52-8727a86ae506 req-8ff6f5f2-88f2-4384-bf93-8d24e53b0c2e service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a7641efb-c67d-4bae-be52-8727a86ae506 req-8ff6f5f2-88f2-4384-bf93-8d24e53b0c2e service nova] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a7641efb-c67d-4bae-be52-8727a86ae506 req-8ff6f5f2-88f2-4384-bf93-8d24e53b0c2e service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a7641efb-c67d-4bae-be52-8727a86ae506 req-8ff6f5f2-88f2-4384-bf93-8d24e53b0c2e service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-a7641efb-c67d-4bae-be52-8727a86ae506 req-8ff6f5f2-88f2-4384-bf93-8d24e53b0c2e service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] No waiting events found dispatching network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:53 user nova-compute[75826]: WARNING nova.compute.manager [req-a7641efb-c67d-4bae-be52-8727a86ae506 req-8ff6f5f2-88f2-4384-bf93-8d24e53b0c2e service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received unexpected event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee for instance with vm_state active and task_state rebuilding.
Nov 16 00:44:53 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Instance destroyed successfully.
Nov 16 00:44:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-361931967',display_name='tempest-ServerActionsTestOtherA-server-928733355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-361931967',id=16,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU0KcpmTuTErG9NaY3SZVpF+AX/WxeRMWWQl0MA4gmj4gnXvVoemz++PrFyKR2DQrAESNN4t09s9GqnpqMN1S2wts2aQeEh/Ie9G5hq2y0lGk8+aBwuQnpRMCQq+GtUtg==',key_name='tempest-keypair-1288954721',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:42:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-mt01qiuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_vif [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap850f4dad-cf, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc9318b4-4b24-43fe-b2bb-d33c40a81aec) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:44:53 user nova-compute[75826]: INFO os_vif [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf')
Nov 16 00:44:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTGQcYvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:44:53 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f5f7e9-42d7-4733-b477-9b395e036ed9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:44:53 user nova-compute[75826]: No targets found.
Nov 16 00:44:53 user nova-compute[75826]: iSNS:
Nov 16 00:44:53 user nova-compute[75826]: No targets found.
Nov 16 00:44:53 user nova-compute[75826]: STATIC:
Nov 16 00:44:53 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:44:53 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:44:53 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:44:53 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:44:53 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:44:53 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:44:53 user nova-compute[75826]: FIRMWARE:
Nov 16 00:44:53 user nova-compute[75826]: No targets found.
Nov 16 00:44:53 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:44:53 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:44:53 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[58aeb80e-6543-475e-adf2-a03fff6e325d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updated VIF entry in instance network info cache for port d9656c82-57df-4891-9c78-531de3f2c5aa. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating instance_info_cache with network_info: [{"id": "950ac11c-60e7-4772-ab1f-51235827d355", "address": "fa:16:3e:9c:63:6f", "network": {"id": "72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-711726094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950ac11c-60", "ovs_interfaceid": "950ac11c-60e7-4772-ab1f-51235827d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3753c6de-ba1a-4839-81db-e9920a6b815f", "address": "fa:16:3e:c1:93:99", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753c6de-ba", "ovs_interfaceid": "3753c6de-ba1a-4839-81db-e9920a6b815f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6a20b4fc-d87a-47be-b7ad-42c399caa3a0 req-c33d7e38-39c5-4bb8-83a6-394b2ea24bbb service nova] Releasing lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b81c8ab-9add-4eee-9fba-c10b2f40cdd8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3cefff0b-5cc7-427d-a48c-dfc871285c78 req-f0c9d990-d36a-414c-9956-faa6d5432704 service nova] Acquired lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-3cefff0b-5cc7-427d-a48c-dfc871285c78 req-f0c9d990-d36a-414c-9956-faa6d5432704 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing network info cache for port 605e5626-2a1e-4c78-8781-6bfd370354af {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:53 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:44:53 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:53 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:44:53 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb4239bd0>, {}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Disconnecting from: [] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] <== disconnect_volume: return (79ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:44:53 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Deleting instance files /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8_del
Nov 16 00:44:53 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Deletion of /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8_del complete
Nov 16 00:44:53 user nova-compute[75826]: INFO nova.virt.block_device [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Booting with volume 88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 at /dev/vdb
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.utils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f029c9-a564-4722-8adc-8bc40984560d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e702a632-a5cc-4ced-ab92-1bb8513fe239]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf58e49-2854-4bde-a384-77a2d907d1b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff0e3e7-46f6-4657-99dd-e53d0a989eb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:44:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:44:54 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:44:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[992b13c6-0450-4eaa-8038-db420b7fc97a]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG os_brick.utils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Updating existing volume attachment record: 26f3c4a1-337d-418c-91a3-ccca81bbd05b {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.network.neutron [req-3cefff0b-5cc7-427d-a48c-dfc871285c78 req-f0c9d990-d36a-414c-9956-faa6d5432704 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updated VIF entry in instance network info cache for port 605e5626-2a1e-4c78-8781-6bfd370354af. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.network.neutron [req-3cefff0b-5cc7-427d-a48c-dfc871285c78 req-f0c9d990-d36a-414c-9956-faa6d5432704 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating instance_info_cache with network_info: [{"id": "950ac11c-60e7-4772-ab1f-51235827d355", "address": "fa:16:3e:9c:63:6f", "network": {"id": "72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-711726094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950ac11c-60", "ovs_interfaceid": "950ac11c-60e7-4772-ab1f-51235827d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3753c6de-ba1a-4839-81db-e9920a6b815f", "address": "fa:16:3e:c1:93:99", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753c6de-ba", "ovs_interfaceid": "3753c6de-ba1a-4839-81db-e9920a6b815f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3cefff0b-5cc7-427d-a48c-dfc871285c78 req-f0c9d990-d36a-414c-9956-faa6d5432704 service nova] Releasing lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:44:54 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Instance spawned successfully.
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-93372919-ac7d-4511-94e7-d4b40563e375 req-306f6739-39ca-4b5f-84bd-a7652950f652 service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received event network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-93372919-ac7d-4511-94e7-d4b40563e375 req-306f6739-39ca-4b5f-84bd-a7652950f652 service nova] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-93372919-ac7d-4511-94e7-d4b40563e375 req-306f6739-39ca-4b5f-84bd-a7652950f652 service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-93372919-ac7d-4511-94e7-d4b40563e375 req-306f6739-39ca-4b5f-84bd-a7652950f652 service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-93372919-ac7d-4511-94e7-d4b40563e375 req-306f6739-39ca-4b5f-84bd-a7652950f652 service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] No waiting events found dispatching network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:54 user nova-compute[75826]: WARNING nova.compute.manager [req-93372919-ac7d-4511-94e7-d4b40563e375 req-306f6739-39ca-4b5f-84bd-a7652950f652 service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received unexpected event network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 for instance with vm_state building and task_state spawning.
Nov 16 00:44:54 user nova-compute[75826]: INFO nova.compute.manager [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Took 7.37 seconds to spawn the instance on the hypervisor.
Nov 16 00:44:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:44:54 user nova-compute[75826]: INFO nova.compute.manager [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Took 8.36 seconds to build instance.
Nov 16 00:44:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-401e9712-4616-4f74-8892-46a76a621f66 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5be68126-c125-441d-8f82-4c474b7ce768" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.456s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:55 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:44:55 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Port 7cb43f66-87cf-4cac-85ab-abfe01ff82cc binding to destination host user is already ACTIVE {{(pid=75826) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 00:44:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquired lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:55 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:44:55 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating instance_info_cache with network_info: [{"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:44:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Releasing lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:44:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Creating tmpfile /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/tmp1zphzqdy to verify with other compute node that the instance is on the same shared storage. {{(pid=75826) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 16 00:44:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:44:56 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Instance destroyed successfully.
Nov 16 00:44:56 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lazy-loading 'resources' on Instance uuid 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-128052432',display_name='tempest-ServerActionsTestOtherB-server-128052432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-128052432',id=4,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXVSxyrOOv945LMuSP1ZSY2bKy/r2ENoqaOk1WP30X55vRshqh2IlMTn2ZQNXytP2IoxEzIDq41/VjnE1Be/JLQH8UoBKnsMheiLtYOBuEJV23nUuMbFcWJ5C5rYTqIuQ==',key_name='tempest-keypair-103688613',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:43:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='150aa3cf14d44a658edb06ade47a2d10',ramdisk_id='',reservation_id='r-tzkzh647',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1007762654',owner_user_name='tempest-ServerActionsTestOtherB-1007762654-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:43:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19886e0e1844467785425d17411f9656',uuid=713e6618-89af-47e0-ba5a-4f77cb1d7ff6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converting VIF {"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_vif [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cb43f66-87, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a57111fd-9450-4e0d-9c56-932d86d9a8ee) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:44:56 user nova-compute[75826]: INFO os_vif [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87')
Nov 16 00:44:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEVTKsux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:44:56 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f63a61-ccd3-47bc-bc39-f4ed57990dde]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:44:56 user nova-compute[75826]: No targets found.
Nov 16 00:44:56 user nova-compute[75826]: iSNS:
Nov 16 00:44:56 user nova-compute[75826]: No targets found.
Nov 16 00:44:56 user nova-compute[75826]: STATIC:
Nov 16 00:44:56 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:44:56 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:44:56 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:44:56 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:44:56 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:44:56 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:44:56 user nova-compute[75826]: FIRMWARE:
Nov 16 00:44:56 user nova-compute[75826]: No targets found.
Nov 16 00:44:56 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:44:56 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:44:56 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[58dc5ca1-f770-4815-bf14-47d601186df3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd4372ef-60dc-4645-968d-5522b6b4f9f1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:56 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:44:56 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:56 user nova-compute[75826]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:44:56 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd942afd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18'): ({'sdc'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Removing single pathed devices sdc {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[474c2c14-0e0a-44d8-9e30-3e0a4e4546e2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-766872c9-0eb8-4008-b3b3-97798c9b7344 req-8846b95c-e96e-4096-b4d8-5d3d58a98864 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-unplugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-766872c9-0eb8-4008-b3b3-97798c9b7344 req-8846b95c-e96e-4096-b4d8-5d3d58a98864 service nova] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-766872c9-0eb8-4008-b3b3-97798c9b7344 req-8846b95c-e96e-4096-b4d8-5d3d58a98864 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-766872c9-0eb8-4008-b3b3-97798c9b7344 req-8846b95c-e96e-4096-b4d8-5d3d58a98864 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-766872c9-0eb8-4008-b3b3-97798c9b7344 req-8846b95c-e96e-4096-b4d8-5d3d58a98864 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] No waiting events found dispatching network-vif-unplugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:56 user nova-compute[75826]: WARNING nova.compute.manager [req-766872c9-0eb8-4008-b3b3-97798c9b7344 req-8846b95c-e96e-4096-b4d8-5d3d58a98864 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received unexpected event network-vif-unplugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc for instance with vm_state resized and task_state resize_reverting.
Nov 16 00:44:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-766872c9-0eb8-4008-b3b3-97798c9b7344 req-8846b95c-e96e-4096-b4d8-5d3d58a98864 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-766872c9-0eb8-4008-b3b3-97798c9b7344 req-8846b95c-e96e-4096-b4d8-5d3d58a98864 service nova] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-766872c9-0eb8-4008-b3b3-97798c9b7344 req-8846b95c-e96e-4096-b4d8-5d3d58a98864 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-766872c9-0eb8-4008-b3b3-97798c9b7344 req-8846b95c-e96e-4096-b4d8-5d3d58a98864 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-766872c9-0eb8-4008-b3b3-97798c9b7344 req-8846b95c-e96e-4096-b4d8-5d3d58a98864 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] No waiting events found dispatching network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:44:56 user nova-compute[75826]: WARNING nova.compute.manager [req-766872c9-0eb8-4008-b3b3-97798c9b7344 req-8846b95c-e96e-4096-b4d8-5d3d58a98864 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received unexpected event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc for instance with vm_state resized and task_state resize_reverting.
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58b875a-c00f-4994-9d2c-5248b0198184]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Flushing IO for device /dev/sdc {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb40b75-d652-4810-bc75-5bb1545e66cd]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9badae95-ff12-44fb-98f6-05f0149d43e9]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89f0cfb-7d2d-4e14-86f7-71c363a7b631]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5769c0-c2f2-467c-a955-7fe78de308a5]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260]
Nov 16 00:44:56 user nova-compute[75826]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260] successful.
Nov 16 00:44:56 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7d660e-187c-49c8-a2c4-7ad4190e1568]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] <== disconnect_volume: return (324ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:44:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:44:57 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:44:58 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Creating image(s)
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Ensure instance console log exists: /opt/stack/data/nova/instances/535e7401-0fb4-4e12-9110-515c63fd32c0/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Start _get_guest_xml network_info=[{"id": "950ac11c-60e7-4772-ab1f-51235827d355", "address": "fa:16:3e:9c:63:6f", "network": {"id": "72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-711726094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950ac11c-60", "ovs_interfaceid": "950ac11c-60e7-4772-ab1f-51235827d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3753c6de-ba1a-4839-81db-e9920a6b815f", "address": "fa:16:3e:c1:93:99", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753c6de-ba", "ovs_interfaceid": "3753c6de-ba1a-4839-81db-e9920a6b815f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ad13d6d3-556d-46fe-af5d-d8b2fea01c39', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUnsTDdi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '535e7401-0fb4-4e12-9110-515c63fd32c0', 'attached_at': '', 'detached_at': '', 'volume_id': '9ae16302-65c4-4d3a-b525-4e1c7260ed1a', 'serial': '9ae16302-65c4-4d3a-b525-4e1c7260ed1a'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': '58746261-5ec7-445d-8703-e5b1281ddaa3', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLYGFuOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '535e7401-0fb4-4e12-9110-515c63fd32c0', 'attached_at': '', 'detached_at': '', 'volume_id': '2c135a70-4e99-4e05-bce1-847f292dcbd3', 'serial': '2c135a70-4e99-4e05-bce1-847f292dcbd3'}, 'boot_index': 1, 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': '90a592c3-60e4-46a9-9661-1b69a435e682', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSDzPcVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '535e7401-0fb4-4e12-9110-515c63fd32c0', 'attached_at': '', 'detached_at': '', 'volume_id': '0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a', 'serial': '0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a'}, 'boot_index': 2, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:44:58 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:44:58 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUnsTDdi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:44:58 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:44:58 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:44:58 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[18002636-1a30-4a94-9ce7-44cc2b29e317]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:44:58 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e789ad-947c-4cb7-aad2-a40411a5071d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a] added
Nov 16 00:44:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5258ad-7a97-43a5-9d75-52574c118aa9]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lazy-loading 'migration_context' on Instance uuid 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e021754a-2f69-4e9d-9ad5-719460479c07]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUnsTDdi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.objects.base [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Object Instance<713e6618-89af-47e0-ba5a-4f77cb1d7ff6> lazy-loaded attributes: resources,migration_context {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JUnsTDdi" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[04026277-45f1-4d47-b268-5fe430e61c9a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JUnsTDdi'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1549936-bcbd-4574-b87b-a3b259c8ff1f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a259eca1-e566-4106-830a-afc3c4bb0bf2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a53ae8-1da3-4478-abc8-e78dcab0d0df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a, portal: 172.16.0.220,3260]
Nov 16 00:44:58 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a, portal: 172.16.0.220,3260] successful.
Nov 16 00:44:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab1dbad-8eae-407c-8ca2-cb001b53e95a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[225380b4-d6ba-4910-9088-cd37f8c1bbac]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:58 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:44:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:58 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:44:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eca62cc-76ea-4c5a-8788-2bfc688187f3]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUnsTDdi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:44:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.583s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:44:59 user nova-compute[75826]: INFO nova.compute.manager [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Swapping old allocation on dict_keys(['015246d3-5250-41ea-8943-b837ba3f5938']) held by migration c39a107f-a195-4679-897b-99f03b3e585a for instance
Nov 16 00:44:59 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Overwriting current allocation {'allocations': {'015246d3-5250-41ea-8943-b837ba3f5938': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 26}}, 'project_id': '150aa3cf14d44a658edb06ade47a2d10', 'user_id': '19886e0e1844467785425d17411f9656', 'consumer_generation': 1} on consumer 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 {{(pid=75826) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquired lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:44:59 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Creating image(s)
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "/opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "/opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "/opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23062366539643865', 'path': '/dev/sdc'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062366539643865', 'path': '/dev/sdc'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLYGFuOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:44:59 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:44:59 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:44:59 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32ae501-2cbd-407e-9feb-17d1972ea750]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:44:59 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[da577325-10b6-4e43-828e-efb0ac49d4ef]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3] added
Nov 16 00:44:59 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb46d7f9-aee7-4c15-9412-35200a9f08a8]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.189s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27f60cc-06aa-487f-8c42-3ad2cb22c668]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLYGFuOX {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk 1073741824" returned: 0 in 0.049s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hLYGFuOX" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abd0c77-2f80-4a6f-8481-6deca2c29fbc]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hLYGFuOX'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2aa181f-ef41-409a-9cde-8163de9221e0]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd477f9-57e1-4660-afee-2a43a81bc42a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:59 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:44:59 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:44:59 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:44:59 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:44:59 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1763c950-180b-4705-90ab-aa656e002786]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3, portal: 172.16.0.220,3260]
Nov 16 00:45:00 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3, portal: 172.16.0.220,3260] successful.
Nov 16 00:45:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.194s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7c8d5b-e364-486c-a9b8-9a09d1868716]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7787bf15-a4ec-4e88-ae94-3bc5bd389985]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:00 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:00 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:00 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:00 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.478s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[365dbc4a-44fb-439d-8a76-7bfd449736b2]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLYGFuOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Cannot resize image /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Ensure instance console log exists: /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Start _get_guest_xml network_info=[{"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '26f3c4a1-337d-418c-91a3-ccca81bbd05b', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTGQcYvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8', 'attached_at': '', 'detached_at': '', 'volume_id': '88fa2ef5-c0dd-4acb-8376-9e74e9e0c087', 'serial': '88fa2ef5-c0dd-4acb-8376-9e74e9e0c087'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating instance_info_cache with network_info: [{"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:45:00 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 00:45:00 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.objects.instance [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Releasing lock "refresh_cache-713e6618-89af-47e0-ba5a-4f77cb1d7ff6" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.utils [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTGQcYvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:45:00 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5bebeb-179f-48f3-bc67-dcd99b085f37]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[970abbd3-9706-4806-9c39-68dcbeeb9f5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3af237-3ff3-4086-84c8-e924e606511e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[324b4b4f-205c-4ed6-813b-8ff715286e21]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:45:00 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c29a18-3887-4e8a-90dd-610abf14fc6a]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG os_brick.utils [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] <== get_connector_properties: return (181ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.528s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] <== connect_volume: return (1532ms) {'type': 'block', 'scsi_wwn': '23936373234616566', 'path': '/dev/sdd'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23936373234616566', 'path': '/dev/sdd'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.899s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:45:01 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:45:01 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f576d7-687b-4409-aa45-44ffa4930ead]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:45:01 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSDzPcVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:45:01 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a68020c-7673-4bdb-8dad-10f619cb0d6b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087] added
Nov 16 00:45:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66fbd7e-fd48-4207-90fa-692d24389847]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7719d375-830c-4f0c-8047-2874d4a50fe1]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fTGQcYvd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fTGQcYvd" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f89eee-ff3e-4d53-877a-b377a07f2d17]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fTGQcYvd'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecc2249-310f-4179-b845-4cbff1313a5a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f1d507-2d42-4a4a-9ec1-80e49681986a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:01 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:01 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:01 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:01 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5544662c-a79c-40d2-94dd-40945e2638f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260]
Nov 16 00:45:01 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260] successful.
Nov 16 00:45:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[70be4489-5710-43de-a56d-f027c03353e7]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b558f16-8028-41a8-a46b-e6efd59ee0fa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:01 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:01 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:01 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:01 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:01 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:01 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7246850b-dc06-4c30-99a1-10bef2334a36]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTGQcYvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] <== connect_volume: return (2278ms) {'type': 'block', 'scsi_wwn': '23234613239616261', 'path': '/dev/sde'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234613239616261', 'path': '/dev/sde'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.343s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:45:02 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:45:02 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[55245b15-7e29-4ab6-a8ac-2dc8808bbe3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:45:02 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T00:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-361931967',display_name='tempest-ServerActionsTestOtherA-server-928733355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-361931967',id=16,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU0KcpmTuTErG9NaY3SZVpF+AX/WxeRMWWQl0MA4gmj4gnXvVoemz++PrFyKR2DQrAESNN4t09s9GqnpqMN1S2wts2aQeEh/Ie9G5hq2y0lGk8+aBwuQnpRMCQq+GtUtg==',key_name='tempest-keypair-1288954721',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:42:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-mt01qiuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:45:02 user nova-compute[75826]:   <uuid>4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8</uuid>
Nov 16 00:45:02 user nova-compute[75826]:   <name>instance-00000010</name>
Nov 16 00:45:02 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:45:02 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:45:02 user nova-compute[75826]:   <metadata>
Nov 16 00:45:02 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:45:02 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:45:02 user nova-compute[75826]:       <nova:name>tempest-ServerActionsTestOtherA-server-928733355</nova:name>
Nov 16 00:45:02 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:45:00</nova:creationTime>
Nov 16 00:45:02 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:45:02 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:45:02 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:45:02 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:45:02 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:45:02 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:45:02 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:45:02 user nova-compute[75826]:       <nova:owner>
Nov 16 00:45:02 user nova-compute[75826]:         <nova:user uuid="055179a465cc4327b4ce68af5018608c">tempest-ServerActionsTestOtherA-329506797-project-member</nova:user>
Nov 16 00:45:02 user nova-compute[75826]:         <nova:project uuid="4d0d81c4b6d0415681092d61ea35de51">tempest-ServerActionsTestOtherA-329506797</nova:project>
Nov 16 00:45:02 user nova-compute[75826]:       </nova:owner>
Nov 16 00:45:02 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:45:02 user nova-compute[75826]:       <nova:ports>
Nov 16 00:45:02 user nova-compute[75826]:         <nova:port uuid="850f4dad-cf10-4839-a39f-16868c918dee">
Nov 16 00:45:02 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 00:45:02 user nova-compute[75826]:         </nova:port>
Nov 16 00:45:02 user nova-compute[75826]:       </nova:ports>
Nov 16 00:45:02 user nova-compute[75826]:     </nova:instance>
Nov 16 00:45:02 user nova-compute[75826]:   </metadata>
Nov 16 00:45:02 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:45:02 user nova-compute[75826]:     <system>
Nov 16 00:45:02 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:45:02 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:45:02 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:45:02 user nova-compute[75826]:       <entry name="serial">4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8</entry>
Nov 16 00:45:02 user nova-compute[75826]:       <entry name="uuid">4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8</entry>
Nov 16 00:45:02 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:45:02 user nova-compute[75826]:     </system>
Nov 16 00:45:02 user nova-compute[75826]:   </sysinfo>
Nov 16 00:45:02 user nova-compute[75826]:   <os>
Nov 16 00:45:02 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:45:02 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:45:02 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:45:02 user nova-compute[75826]:   </os>
Nov 16 00:45:02 user nova-compute[75826]:   <features>
Nov 16 00:45:02 user nova-compute[75826]:     <acpi/>
Nov 16 00:45:02 user nova-compute[75826]:     <apic/>
Nov 16 00:45:02 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:45:02 user nova-compute[75826]:   </features>
Nov 16 00:45:02 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:45:02 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:45:02 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:45:02 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:45:02 user nova-compute[75826]:   </clock>
Nov 16 00:45:02 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:45:02 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:45:02 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:45:02 user nova-compute[75826]:   </cpu>
Nov 16 00:45:02 user nova-compute[75826]:   <devices>
Nov 16 00:45:02 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:45:02 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:45:02 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk"/>
Nov 16 00:45:02 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:45:02 user nova-compute[75826]:     </disk>
Nov 16 00:45:02 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:45:02 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:45:02 user nova-compute[75826]:       <source dev="/dev/sde"/>
Nov 16 00:45:02 user nova-compute[75826]:       <target dev="vdb" bus="virtio"/>
Nov 16 00:45:02 user nova-compute[75826]:       <serial>88fa2ef5-c0dd-4acb-8376-9e74e9e0c087</serial>
Nov 16 00:45:02 user nova-compute[75826]:     </disk>
Nov 16 00:45:02 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:45:02 user nova-compute[75826]:       <mac address="fa:16:3e:7c:72:81"/>
Nov 16 00:45:02 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:45:02 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:45:02 user nova-compute[75826]:       <target dev="tap850f4dad-cf"/>
Nov 16 00:45:02 user nova-compute[75826]:     </interface>
Nov 16 00:45:02 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:45:02 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/console.log" append="off"/>
Nov 16 00:45:02 user nova-compute[75826]:     </serial>
Nov 16 00:45:02 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:45:02 user nova-compute[75826]:     <video>
Nov 16 00:45:02 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:45:02 user nova-compute[75826]:     </video>
Nov 16 00:45:02 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:45:02 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:45:02 user nova-compute[75826]:     </rng>
Nov 16 00:45:02 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:45:02 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:45:02 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:45:02 user nova-compute[75826]:     </memballoon>
Nov 16 00:45:02 user nova-compute[75826]:   </devices>
Nov 16 00:45:02 user nova-compute[75826]: </domain>
Nov 16 00:45:02 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T00:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-361931967',display_name='tempest-ServerActionsTestOtherA-server-928733355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-361931967',id=16,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU0KcpmTuTErG9NaY3SZVpF+AX/WxeRMWWQl0MA4gmj4gnXvVoemz++PrFyKR2DQrAESNN4t09s9GqnpqMN1S2wts2aQeEh/Ie9G5hq2y0lGk8+aBwuQnpRMCQq+GtUtg==',key_name='tempest-keypair-1288954721',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:42:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-mt01qiuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_vif [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a034452b-cd67-4933-bbbd-c290813156f9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a] added
Nov 16 00:45:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15f68b59-ba54-5f05-9b2c-f2a715f09b98', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3abcb6e-462f-4adc-8b14-91e77a365220]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap850f4dad-cf, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap850f4dad-cf, col_values=(('qos', UUID('26b6886e-2391-4b71-9217-dbd017918536')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap850f4dad-cf, col_values=(('external_ids', {'iface-id': '850f4dad-cf10-4839-a39f-16868c918dee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:72:81', 'vm-uuid': '4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd337751-17a6-4547-b887-bd4ab5f600f6]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:02 user nova-compute[75826]: INFO os_vif [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf')
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSDzPcVK {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSDzPcVK" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[64263659-8862-49f4-a57b-3e8c1f783fb0]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uSDzPcVK'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ae1c07-cb71-4201-ac26-9bc7eed59e04]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No VIF found with MAC fa:16:3e:7c:72:81, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b0aefa-b366-4b33-97c2-2406a8d90779]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:02 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:02 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:02 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:02 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:02 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:02 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e470ae0-7bc9-4e44-b7b6-a87f9c3a2b54]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a, portal: 172.16.0.220,3260]
Nov 16 00:45:02 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a, portal: 172.16.0.220,3260] successful.
Nov 16 00:45:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8844260-e409-4b74-8824-fde76865bf91]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c75201-258f-4b88-aafa-375832d383af]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:03 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:03 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:03 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:03 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:03 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:03 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:03 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:03 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[419e6f7e-bbd3-4370-9318-09faeec4212e]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSDzPcVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.046s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] <== connect_volume: return (5389ms) {'type': 'block', 'scsi_wwn': '26165633966333062', 'path': '/dev/sdf'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165633966333062', 'path': '/dev/sdf'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.compute.manager [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-57544d51-71f9-4e71-9f8b-e9e6b81b4823 req-c048b87c-b4c1-4fc0-a0d2-52cd7deee2f4 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-changed-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-57544d51-71f9-4e71-9f8b-e9e6b81b4823 req-c048b87c-b4c1-4fc0-a0d2-52cd7deee2f4 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Refreshing instance network info cache due to event network-changed-ff64782d-047b-4488-80c5-b8866a0c5037. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-57544d51-71f9-4e71-9f8b-e9e6b81b4823 req-c048b87c-b4c1-4fc0-a0d2-52cd7deee2f4 service nova] Acquiring lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-57544d51-71f9-4e71-9f8b-e9e6b81b4823 req-c048b87c-b4c1-4fc0-a0d2-52cd7deee2f4 service nova] Acquired lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.neutron [req-57544d51-71f9-4e71-9f8b-e9e6b81b4823 req-c048b87c-b4c1-4fc0-a0d2-52cd7deee2f4 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Refreshing network info cache for port ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-3a84f46f-f088-4af2-8740-57a11bc0bbb0 req-40a1dd04-3ff4-4704-a85e-bb6185cf7555 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3a84f46f-f088-4af2-8740-57a11bc0bbb0 req-40a1dd04-3ff4-4704-a85e-bb6185cf7555 service nova] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3a84f46f-f088-4af2-8740-57a11bc0bbb0 req-40a1dd04-3ff4-4704-a85e-bb6185cf7555 service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3a84f46f-f088-4af2-8740-57a11bc0bbb0 req-40a1dd04-3ff4-4704-a85e-bb6185cf7555 service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-3a84f46f-f088-4af2-8740-57a11bc0bbb0 req-40a1dd04-3ff4-4704-a85e-bb6185cf7555 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] No waiting events found dispatching network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:06 user nova-compute[75826]: WARNING nova.compute.manager [req-3a84f46f-f088-4af2-8740-57a11bc0bbb0 req-40a1dd04-3ff4-4704-a85e-bb6185cf7555 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received unexpected event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee for instance with vm_state active and task_state rebuild_spawning.
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-22bb3cc8-2ccc-428a-b6a1-39a1bb626f1f req-9889de6d-ccfd-4248-bbfb-1eb6797e2751 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-22bb3cc8-2ccc-428a-b6a1-39a1bb626f1f req-9889de6d-ccfd-4248-bbfb-1eb6797e2751 service nova] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-22bb3cc8-2ccc-428a-b6a1-39a1bb626f1f req-9889de6d-ccfd-4248-bbfb-1eb6797e2751 service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-22bb3cc8-2ccc-428a-b6a1-39a1bb626f1f req-9889de6d-ccfd-4248-bbfb-1eb6797e2751 service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-22bb3cc8-2ccc-428a-b6a1-39a1bb626f1f req-9889de6d-ccfd-4248-bbfb-1eb6797e2751 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] No waiting events found dispatching network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:06 user nova-compute[75826]: WARNING nova.compute.manager [req-22bb3cc8-2ccc-428a-b6a1-39a1bb626f1f req-9889de6d-ccfd-4248-bbfb-1eb6797e2751 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received unexpected event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee for instance with vm_state active and task_state rebuild_spawning.
Nov 16 00:45:06 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:45:06 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7374MB free_disk=25.27151870727539GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:06 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Instance spawned successfully.
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Starting finish_revert_migration {{(pid=75826) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "950ac11c-60e7-4772-ab1f-51235827d355", "address": "fa:16:3e:9c:63:6f", "network": {"id": "72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-711726094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950ac11c-60", "ovs_interfaceid": "950ac11c-60e7-4772-ab1f-51235827d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "950ac11c-60e7-4772-ab1f-51235827d355", "address": "fa:16:3e:9c:63:6f", "network": {"id": "72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-711726094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950ac11c-60", "ovs_interfaceid": "950ac11c-60e7-4772-ab1f-51235827d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:63:6f,bridge_name='br-int',has_traffic_filtering=True,id=950ac11c-60e7-4772-ab1f-51235827d355,network=Network(72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950ac11c-60') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:39:58,bridge_name='br-int',has_traffic_filtering=True,id=44813b22-4904-4534-9674-14220b2ee743,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44813b22-49') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:cc,bridge_name='br-int',has_traffic_filtering=True,id=09a45f64-c713-4faf-b030-9a71edc2bfe5,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09a45f64-c7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3753c6de-ba1a-4839-81db-e9920a6b815f", "address": "fa:16:3e:c1:93:99", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753c6de-ba", "ovs_interfaceid": "3753c6de-ba1a-4839-81db-e9920a6b815f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "3753c6de-ba1a-4839-81db-e9920a6b815f", "address": "fa:16:3e:c1:93:99", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753c6de-ba", "ovs_interfaceid": "3753c6de-ba1a-4839-81db-e9920a6b815f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:93:99,bridge_name='br-int',has_traffic_filtering=True,id=3753c6de-ba1a-4839-81db-e9920a6b815f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753c6de-ba') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:47,bridge_name='br-int',has_traffic_filtering=True,id=5f1e8fd9-8c1e-4815-9320-fe039c91101f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1e8fd9-8c') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:81:23,bridge_name='br-int',has_traffic_filtering=True,id=d9656c82-57df-4891-9c78-531de3f2c5aa,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9656c82-57') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=605e5626-2a1e-4c78-8781-6bfd370354af,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605e5626-2a') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lazy-loading 'pci_devices' on Instance uuid 535e7401-0fb4-4e12-9110-515c63fd32c0 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Start _get_guest_xml network_info=[{"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '94cc2bec-9072-4af6-a0f3-4f69a6af061d', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEVTKsux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '713e6618-89af-47e0-ba5a-4f77cb1d7ff6', 'attached_at': '2023-11-16T00:45:06.000000', 'detached_at': '', 'volume_id': '48b289f4-4b30-4d11-8683-5419d02afa18', 'serial': '48b289f4-4b30-4d11-8683-5419d02afa18'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:45:06 user nova-compute[75826]:   <uuid>535e7401-0fb4-4e12-9110-515c63fd32c0</uuid>
Nov 16 00:45:06 user nova-compute[75826]:   <name>instance-00000015</name>
Nov 16 00:45:06 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:45:06 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:45:06 user nova-compute[75826]:   <metadata>
Nov 16 00:45:06 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:45:06 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:45:06 user nova-compute[75826]:       <nova:name>tempest-device-tagging-server-1630375806</nova:name>
Nov 16 00:45:06 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:44:58</nova:creationTime>
Nov 16 00:45:06 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:45:06 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:45:06 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:45:06 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:45:06 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:45:06 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:45:06 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:45:06 user nova-compute[75826]:       <nova:owner>
Nov 16 00:45:06 user nova-compute[75826]:         <nova:user uuid="38b40689c2324d48bdf1f8ec8d4dc573">tempest-TaggedBootDevicesTest-1314648939-project-member</nova:user>
Nov 16 00:45:06 user nova-compute[75826]:         <nova:project uuid="02b8f62ebb8e4b4c9586b1092aabec74">tempest-TaggedBootDevicesTest-1314648939</nova:project>
Nov 16 00:45:06 user nova-compute[75826]:       </nova:owner>
Nov 16 00:45:06 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:45:06 user nova-compute[75826]:       <nova:ports>
Nov 16 00:45:06 user nova-compute[75826]:         <nova:port uuid="950ac11c-60e7-4772-ab1f-51235827d355">
Nov 16 00:45:06 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 00:45:06 user nova-compute[75826]:         </nova:port>
Nov 16 00:45:06 user nova-compute[75826]:         <nova:port uuid="44813b22-4904-4534-9674-14220b2ee743">
Nov 16 00:45:06 user nova-compute[75826]:           <nova:ip type="fixed" address="10.1.1.250" ipVersion="4"/>
Nov 16 00:45:06 user nova-compute[75826]:         </nova:port>
Nov 16 00:45:06 user nova-compute[75826]:         <nova:port uuid="09a45f64-c713-4faf-b030-9a71edc2bfe5">
Nov 16 00:45:06 user nova-compute[75826]:           <nova:ip type="fixed" address="10.1.1.11" ipVersion="4"/>
Nov 16 00:45:06 user nova-compute[75826]:         </nova:port>
Nov 16 00:45:06 user nova-compute[75826]:         <nova:port uuid="3753c6de-ba1a-4839-81db-e9920a6b815f">
Nov 16 00:45:06 user nova-compute[75826]:           <nova:ip type="fixed" address="10.1.1.19" ipVersion="4"/>
Nov 16 00:45:06 user nova-compute[75826]:         </nova:port>
Nov 16 00:45:06 user nova-compute[75826]:         <nova:port uuid="5f1e8fd9-8c1e-4815-9320-fe039c91101f">
Nov 16 00:45:06 user nova-compute[75826]:           <nova:ip type="fixed" address="10.1.1.41" ipVersion="4"/>
Nov 16 00:45:06 user nova-compute[75826]:         </nova:port>
Nov 16 00:45:06 user nova-compute[75826]:         <nova:port uuid="d9656c82-57df-4891-9c78-531de3f2c5aa">
Nov 16 00:45:06 user nova-compute[75826]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 16 00:45:06 user nova-compute[75826]:         </nova:port>
Nov 16 00:45:06 user nova-compute[75826]:         <nova:port uuid="605e5626-2a1e-4c78-8781-6bfd370354af">
Nov 16 00:45:06 user nova-compute[75826]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 16 00:45:06 user nova-compute[75826]:         </nova:port>
Nov 16 00:45:06 user nova-compute[75826]:       </nova:ports>
Nov 16 00:45:06 user nova-compute[75826]:     </nova:instance>
Nov 16 00:45:06 user nova-compute[75826]:   </metadata>
Nov 16 00:45:06 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:45:06 user nova-compute[75826]:     <system>
Nov 16 00:45:06 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:45:06 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:45:06 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:45:06 user nova-compute[75826]:       <entry name="serial">535e7401-0fb4-4e12-9110-515c63fd32c0</entry>
Nov 16 00:45:06 user nova-compute[75826]:       <entry name="uuid">535e7401-0fb4-4e12-9110-515c63fd32c0</entry>
Nov 16 00:45:06 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:45:06 user nova-compute[75826]:     </system>
Nov 16 00:45:06 user nova-compute[75826]:   </sysinfo>
Nov 16 00:45:06 user nova-compute[75826]:   <os>
Nov 16 00:45:06 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:45:06 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:45:06 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:45:06 user nova-compute[75826]:   </os>
Nov 16 00:45:06 user nova-compute[75826]:   <features>
Nov 16 00:45:06 user nova-compute[75826]:     <acpi/>
Nov 16 00:45:06 user nova-compute[75826]:     <apic/>
Nov 16 00:45:06 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:45:06 user nova-compute[75826]:   </features>
Nov 16 00:45:06 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:45:06 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:45:06 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:45:06 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:45:06 user nova-compute[75826]:   </clock>
Nov 16 00:45:06 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:45:06 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:45:06 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:45:06 user nova-compute[75826]:   </cpu>
Nov 16 00:45:06 user nova-compute[75826]:   <devices>
Nov 16 00:45:06 user nova-compute[75826]:     <disk type="file" device="cdrom">
Nov 16 00:45:06 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none"/>
Nov 16 00:45:06 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/535e7401-0fb4-4e12-9110-515c63fd32c0/disk.config"/>
Nov 16 00:45:06 user nova-compute[75826]:       <target dev="hda" bus="ide"/>
Nov 16 00:45:06 user nova-compute[75826]:     </disk>
Nov 16 00:45:06 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:45:06 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:45:06 user nova-compute[75826]:       <source dev="/dev/sdc"/>
Nov 16 00:45:06 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:45:06 user nova-compute[75826]:       <serial>9ae16302-65c4-4d3a-b525-4e1c7260ed1a</serial>
Nov 16 00:45:06 user nova-compute[75826]:     </disk>
Nov 16 00:45:06 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:45:06 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:45:06 user nova-compute[75826]:       <source dev="/dev/sdd"/>
Nov 16 00:45:06 user nova-compute[75826]:       <target dev="vdb" bus="virtio"/>
Nov 16 00:45:06 user nova-compute[75826]:       <serial>2c135a70-4e99-4e05-bce1-847f292dcbd3</serial>
Nov 16 00:45:06 user nova-compute[75826]:     </disk>
Nov 16 00:45:06 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:45:06 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:45:06 user nova-compute[75826]:       <source dev="/dev/sdf"/>
Nov 16 00:45:06 user nova-compute[75826]:       <target dev="vdc" bus="virtio"/>
Nov 16 00:45:06 user nova-compute[75826]:       <serial>0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a</serial>
Nov 16 00:45:06 user nova-compute[75826]:     </disk>
Nov 16 00:45:06 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:45:06 user nova-compute[75826]:       <mac address="fa:16:3e:9c:63:6f"/>
Nov 16 00:45:06 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:45:06 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:45:06 user nova-compute[75826]:       <target dev="tap950ac11c-60"/>
Nov 16 00:45:06 user nova-compute[75826]:     </interface>
Nov 16 00:45:06 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:45:06 user nova-compute[75826]:       <mac address="fa:16:3e:11:39:58"/>
Nov 16 00:45:06 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:45:06 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:45:06 user nova-compute[75826]:       <target dev="tap44813b22-49"/>
Nov 16 00:45:06 user nova-compute[75826]:     </interface>
Nov 16 00:45:06 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:45:06 user nova-compute[75826]:       <mac address="fa:16:3e:7e:e2:cc"/>
Nov 16 00:45:06 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:45:06 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:45:06 user nova-compute[75826]:       <target dev="tap09a45f64-c7"/>
Nov 16 00:45:06 user nova-compute[75826]:     </interface>
Nov 16 00:45:06 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:45:06 user nova-compute[75826]:       <mac address="fa:16:3e:c1:93:99"/>
Nov 16 00:45:06 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:45:06 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:45:06 user nova-compute[75826]:       <target dev="tap3753c6de-ba"/>
Nov 16 00:45:06 user nova-compute[75826]:     </interface>
Nov 16 00:45:06 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:45:06 user nova-compute[75826]:       <mac address="fa:16:3e:44:8d:47"/>
Nov 16 00:45:06 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:45:06 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:45:06 user nova-compute[75826]:       <target dev="tap5f1e8fd9-8c"/>
Nov 16 00:45:06 user nova-compute[75826]:     </interface>
Nov 16 00:45:06 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:45:06 user nova-compute[75826]:       <mac address="fa:16:3e:88:81:23"/>
Nov 16 00:45:06 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:45:06 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:45:06 user nova-compute[75826]:       <target dev="tapd9656c82-57"/>
Nov 16 00:45:06 user nova-compute[75826]:     </interface>
Nov 16 00:45:06 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:45:06 user nova-compute[75826]:       <mac address="fa:16:3e:f2:d0:6e"/>
Nov 16 00:45:06 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:45:06 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:45:06 user nova-compute[75826]:       <target dev="tap605e5626-2a"/>
Nov 16 00:45:06 user nova-compute[75826]:     </interface>
Nov 16 00:45:06 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:45:06 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/535e7401-0fb4-4e12-9110-515c63fd32c0/console.log" append="off"/>
Nov 16 00:45:06 user nova-compute[75826]:     </serial>
Nov 16 00:45:06 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:45:06 user nova-compute[75826]:     <video>
Nov 16 00:45:06 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:45:06 user nova-compute[75826]:     </video>
Nov 16 00:45:06 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:45:06 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:45:06 user nova-compute[75826]:     </rng>
Nov 16 00:45:06 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:45:06 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:45:06 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:45:06 user nova-compute[75826]:     </memballoon>
Nov 16 00:45:06 user nova-compute[75826]:   </devices>
Nov 16 00:45:06 user nova-compute[75826]: </domain>
Nov 16 00:45:06 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "950ac11c-60e7-4772-ab1f-51235827d355", "address": "fa:16:3e:9c:63:6f", "network": {"id": "72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-711726094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950ac11c-60", "ovs_interfaceid": "950ac11c-60e7-4772-ab1f-51235827d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "950ac11c-60e7-4772-ab1f-51235827d355", "address": "fa:16:3e:9c:63:6f", "network": {"id": "72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-711726094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950ac11c-60", "ovs_interfaceid": "950ac11c-60e7-4772-ab1f-51235827d355", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:63:6f,bridge_name='br-int',has_traffic_filtering=True,id=950ac11c-60e7-4772-ab1f-51235827d355,network=Network(72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950ac11c-60') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:63:6f,bridge_name='br-int',has_traffic_filtering=True,id=950ac11c-60e7-4772-ab1f-51235827d355,network=Network(72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950ac11c-60') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b0b62222-73cb-550b-93b6-b4799af4750d', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.compute.manager [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap950ac11c-60, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap950ac11c-60, col_values=(('qos', UUID('e740eeed-5a80-4a36-9c39-73c388da7a5d')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap950ac11c-60, col_values=(('external_ids', {'iface-id': '950ac11c-60e7-4772-ab1f-51235827d355', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:63:6f', 'vm-uuid': '535e7401-0fb4-4e12-9110-515c63fd32c0'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:06 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:45:06 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:45:06 user nova-compute[75826]: INFO os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:63:6f,bridge_name='br-int',has_traffic_filtering=True,id=950ac11c-60e7-4772-ab1f-51235827d355,network=Network(72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950ac11c-60')
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:39:58,bridge_name='br-int',has_traffic_filtering=True,id=44813b22-4904-4534-9674-14220b2ee743,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44813b22-49') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:39:58,bridge_name='br-int',has_traffic_filtering=True,id=44813b22-4904-4534-9674-14220b2ee743,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44813b22-49') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b1733a6-befc-5b29-99de-55190ba0e964', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lazy-loading 'vcpu_model' on Instance uuid 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEVTKsux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:45:06 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:45:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:45:06 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:45:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:45:06 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44813b22-49, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44813b22-49, col_values=(('qos', UUID('f6ce7a5e-874f-4138-8c0d-c06a005a87ea')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44813b22-49, col_values=(('external_ids', {'iface-id': '44813b22-4904-4534-9674-14220b2ee743', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:39:58', 'vm-uuid': '535e7401-0fb4-4e12-9110-515c63fd32c0'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8318e347-a382-4098-9428-30f59348e2ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:45:06 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: INFO os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:39:58,bridge_name='br-int',has_traffic_filtering=True,id=44813b22-4904-4534-9674-14220b2ee743,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44813b22-49')
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:cc,bridge_name='br-int',has_traffic_filtering=True,id=09a45f64-c713-4faf-b030-9a71edc2bfe5,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09a45f64-c7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:cc,bridge_name='br-int',has_traffic_filtering=True,id=09a45f64-c713-4faf-b030-9a71edc2bfe5,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09a45f64-c7') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df34b976-3b8a-578b-ad41-2f3605a52a57', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85098fa-2e17-49f5-8f06-a79b85be9d6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18] added
Nov 16 00:45:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09a45f64-c7, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09a45f64-c7, col_values=(('qos', UUID('8428c39c-417a-4a55-9522-a2eac3171c95')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09a45f64-c7, col_values=(('external_ids', {'iface-id': '09a45f64-c713-4faf-b030-9a71edc2bfe5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:e2:cc', 'vm-uuid': '535e7401-0fb4-4e12-9110-515c63fd32c0'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[249bb186-898b-4bed-ac0e-1d9628b21c87]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d5cae8-f7f2-4232-bba7-4aac6a4bf21b]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEVTKsux {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: INFO os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:cc,bridge_name='br-int',has_traffic_filtering=True,id=09a45f64-c713-4faf-b030-9a71edc2bfe5,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09a45f64-c7')
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3753c6de-ba1a-4839-81db-e9920a6b815f", "address": "fa:16:3e:c1:93:99", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753c6de-ba", "ovs_interfaceid": "3753c6de-ba1a-4839-81db-e9920a6b815f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "3753c6de-ba1a-4839-81db-e9920a6b815f", "address": "fa:16:3e:c1:93:99", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753c6de-ba", "ovs_interfaceid": "3753c6de-ba1a-4839-81db-e9920a6b815f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:93:99,bridge_name='br-int',has_traffic_filtering=True,id=3753c6de-ba1a-4839-81db-e9920a6b815f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753c6de-ba') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:93:99,bridge_name='br-int',has_traffic_filtering=True,id=3753c6de-ba1a-4839-81db-e9920a6b815f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753c6de-ba') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '14ece097-a7e9-5883-a624-826dca9352b7', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CEVTKsux" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[038c570f-e065-47e9-a191-1cfe36cf6fd6]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CEVTKsux'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance d9ac6719-80f7-490a-a51e-869b51118aa2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 298c8986-b91b-4f46-bcce-75e28bc02b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance eeb0e320-431c-44ad-bbb9-3eda75234ed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7c67f025-987e-435c-b1d9-7936832fe72b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 1621d261-aa12-4e57-a74e-fe565d921320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 535e7401-0fb4-4e12-9110-515c63fd32c0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 5be68126-c125-441d-8f82-4c474b7ce768 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3753c6de-ba, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3753c6de-ba, col_values=(('qos', UUID('acbf2c67-6dc4-4b1a-9052-e6bca37f23ce')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3753c6de-ba, col_values=(('external_ids', {'iface-id': '3753c6de-ba1a-4839-81db-e9920a6b815f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:93:99', 'vm-uuid': '535e7401-0fb4-4e12-9110-515c63fd32c0'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.045s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13a7acf-feca-4f62-9f97-23c56298c0db]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing inventories for resource provider 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[127ce704-359b-4e9e-8eb4-0fc7c9bd60ea]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: INFO os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:93:99,bridge_name='br-int',has_traffic_filtering=True,id=3753c6de-ba1a-4839-81db-e9920a6b815f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753c6de-ba')
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:47,bridge_name='br-int',has_traffic_filtering=True,id=5f1e8fd9-8c1e-4815-9320-fe039c91101f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1e8fd9-8c') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:47,bridge_name='br-int',has_traffic_filtering=True,id=5f1e8fd9-8c1e-4815-9320-fe039c91101f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1e8fd9-8c') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf4805ce-9bd2-55d6-9759-dcca238f1b2f', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating ProviderTree inventory for provider 015246d3-5250-41ea-8943-b837ba3f5938 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating inventory in ProviderTree for provider 015246d3-5250-41ea-8943-b837ba3f5938 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing aggregate associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, aggregates: None {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5f1e8fd9-8c, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5f1e8fd9-8c, col_values=(('qos', UUID('5dff67ef-dba5-483e-9cf1-1b7fe89c2b44')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5f1e8fd9-8c, col_values=(('external_ids', {'iface-id': '5f1e8fd9-8c1e-4815-9320-fe039c91101f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:8d:47', 'vm-uuid': '535e7401-0fb4-4e12-9110-515c63fd32c0'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e333aed-fe91-4eeb-884c-377f9b339982]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.objects.instance [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'flavor' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260]
Nov 16 00:45:07 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260] successful.
Nov 16 00:45:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing trait associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b9f4d9c-54ab-41ed-ba5f-6a64f4c90434]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.network.neutron [req-57544d51-71f9-4e71-9f8b-e9e6b81b4823 req-c048b87c-b4c1-4fc0-a0d2-52cd7deee2f4 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Updated VIF entry in instance network info cache for port ff64782d-047b-4488-80c5-b8866a0c5037. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.network.neutron [req-57544d51-71f9-4e71-9f8b-e9e6b81b4823 req-c048b87c-b4c1-4fc0-a0d2-52cd7deee2f4 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Updating instance_info_cache with network_info: [{"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: INFO os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:47,bridge_name='br-int',has_traffic_filtering=True,id=5f1e8fd9-8c1e-4815-9320-fe039c91101f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1e8fd9-8c')
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:81:23,bridge_name='br-int',has_traffic_filtering=True,id=d9656c82-57df-4891-9c78-531de3f2c5aa,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9656c82-57') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:81:23,bridge_name='br-int',has_traffic_filtering=True,id=d9656c82-57df-4891-9c78-531de3f2c5aa,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9656c82-57') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-57544d51-71f9-4e71-9f8b-e9e6b81b4823 req-c048b87c-b4c1-4fc0-a0d2-52cd7deee2f4 service nova] Releasing lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1c342e-c531-4d88-93c4-b51056cdf6f4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.107s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:07 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:45:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] HCTL ('38', '-', '-', 0) found on session 22 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46447a10-d003-588d-8399-a65e59a352f9', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[63457ebb-8bc1-43f0-9c7a-1bc5e951164b]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9656c82-57, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9656c82-57, col_values=(('qos', UUID('fd39e85a-90f8-4d87-bbe5-a4f7c9efb1ca')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9656c82-57, col_values=(('external_ids', {'iface-id': 'd9656c82-57df-4891-9c78-531de3f2c5aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:81:23', 'vm-uuid': '535e7401-0fb4-4e12-9110-515c63fd32c0'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: INFO os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:81:23,bridge_name='br-int',has_traffic_filtering=True,id=d9656c82-57df-4891-9c78-531de3f2c5aa,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9656c82-57')
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:44:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=605e5626-2a1e-4c78-8781-6bfd370354af,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605e5626-2a') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=605e5626-2a1e-4c78-8781-6bfd370354af,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605e5626-2a') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b48218b0-68d6-5c12-815c-6654a11da6d7', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:07 user nova-compute[75826]: INFO nova.compute.manager [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Attaching volume 614386b6-09ef-4bd9-b7ff-475392da7e4c to /dev/vdb
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap605e5626-2a, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap605e5626-2a, col_values=(('qos', UUID('50eb92fe-2d7e-4c56-8076-c7501ef1e51a')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap605e5626-2a, col_values=(('external_ids', {'iface-id': '605e5626-2a1e-4c78-8781-6bfd370354af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:d0:6e', 'vm-uuid': '535e7401-0fb4-4e12-9110-515c63fd32c0'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.utils [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[273aaf09-4ec0-4245-9d33-d9ac260b41d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:07 user nova-compute[75826]: INFO os_vif [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=605e5626-2a1e-4c78-8781-6bfd370354af,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605e5626-2a')
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.081s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[864be75d-2d48-4337-a05b-a68943a52ab8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.819s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.objects.instance [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75826) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7703ad4e-a9e2-4562-acda-2a746258f7b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] There are 0 instances to clean {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[91693ee3-b738-4be6-bac9-007440693530]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75826) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:45:07 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb429f5c-eea3-43ee-a7e0-61b1cbf2e06e]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG os_brick.utils [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Updating existing volume attachment record: 86a26875-290a-4b30-87ce-8ab063a01175 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00482665-b3da-4ee6-aeaf-143f92ea417c tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.124s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] No BDM found with device name hda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] No VIF found with MAC fa:16:3e:9c:63:6f, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:45:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] No VIF found with MAC fa:16:3e:44:8d:47, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:45:07 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Using config drive
Nov 16 00:45:08 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Creating config drive at /opt/stack/data/nova/instances/535e7401-0fb4-4e12-9110-515c63fd32c0/disk.config
Nov 16 00:45:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/535e7401-0fb4-4e12-9110-515c63fd32c0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5hhnjcjq {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/535e7401-0fb4-4e12-9110-515c63fd32c0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp5hhnjcjq" returned: 0 in 0.062s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Searching for a device in session 22 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEVTKsux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '26437323930643766', 'path': '/dev/sdg'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437323930643766', 'path': '/dev/sdg'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-128052432',display_name='tempest-ServerActionsTestOtherB-server-128052432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-128052432',id=4,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXVSxyrOOv945LMuSP1ZSY2bKy/r2ENoqaOk1WP30X55vRshqh2IlMTn2ZQNXytP2IoxEzIDq41/VjnE1Be/JLQH8UoBKnsMheiLtYOBuEJV23nUuMbFcWJ5C5rYTqIuQ==',key_name='tempest-keypair-103688613',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:43:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='150aa3cf14d44a658edb06ade47a2d10',ramdisk_id='',reservation_id='r-tzkzh647',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1007762654',owner_user_name='tempest-ServerActionsTestOtherB-1007762654-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19886e0e1844467785425d17411f9656',uuid=713e6618-89af-47e0-ba5a-4f77cb1d7ff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converting VIF {"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:45:08 user nova-compute[75826]:   <uuid>713e6618-89af-47e0-ba5a-4f77cb1d7ff6</uuid>
Nov 16 00:45:08 user nova-compute[75826]:   <name>instance-00000004</name>
Nov 16 00:45:08 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:45:08 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:45:08 user nova-compute[75826]:   <metadata>
Nov 16 00:45:08 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:45:08 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:45:08 user nova-compute[75826]:       <nova:name>tempest-ServerActionsTestOtherB-server-128052432</nova:name>
Nov 16 00:45:08 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:45:06</nova:creationTime>
Nov 16 00:45:08 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:45:08 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:45:08 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:45:08 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:45:08 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:45:08 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:45:08 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:45:08 user nova-compute[75826]:       <nova:owner>
Nov 16 00:45:08 user nova-compute[75826]:         <nova:user uuid="19886e0e1844467785425d17411f9656">tempest-ServerActionsTestOtherB-1007762654-project-member</nova:user>
Nov 16 00:45:08 user nova-compute[75826]:         <nova:project uuid="150aa3cf14d44a658edb06ade47a2d10">tempest-ServerActionsTestOtherB-1007762654</nova:project>
Nov 16 00:45:08 user nova-compute[75826]:       </nova:owner>
Nov 16 00:45:08 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:45:08 user nova-compute[75826]:       <nova:ports>
Nov 16 00:45:08 user nova-compute[75826]:         <nova:port uuid="7cb43f66-87cf-4cac-85ab-abfe01ff82cc">
Nov 16 00:45:08 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 00:45:08 user nova-compute[75826]:         </nova:port>
Nov 16 00:45:08 user nova-compute[75826]:       </nova:ports>
Nov 16 00:45:08 user nova-compute[75826]:     </nova:instance>
Nov 16 00:45:08 user nova-compute[75826]:   </metadata>
Nov 16 00:45:08 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:45:08 user nova-compute[75826]:     <system>
Nov 16 00:45:08 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:45:08 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:45:08 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:45:08 user nova-compute[75826]:       <entry name="serial">713e6618-89af-47e0-ba5a-4f77cb1d7ff6</entry>
Nov 16 00:45:08 user nova-compute[75826]:       <entry name="uuid">713e6618-89af-47e0-ba5a-4f77cb1d7ff6</entry>
Nov 16 00:45:08 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:45:08 user nova-compute[75826]:     </system>
Nov 16 00:45:08 user nova-compute[75826]:   </sysinfo>
Nov 16 00:45:08 user nova-compute[75826]:   <os>
Nov 16 00:45:08 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:45:08 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:45:08 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:45:08 user nova-compute[75826]:   </os>
Nov 16 00:45:08 user nova-compute[75826]:   <features>
Nov 16 00:45:08 user nova-compute[75826]:     <acpi/>
Nov 16 00:45:08 user nova-compute[75826]:     <apic/>
Nov 16 00:45:08 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:45:08 user nova-compute[75826]:   </features>
Nov 16 00:45:08 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:45:08 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:45:08 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:45:08 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:45:08 user nova-compute[75826]:   </clock>
Nov 16 00:45:08 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:45:08 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:45:08 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:45:08 user nova-compute[75826]:   </cpu>
Nov 16 00:45:08 user nova-compute[75826]:   <devices>
Nov 16 00:45:08 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:45:08 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:45:08 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk"/>
Nov 16 00:45:08 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:45:08 user nova-compute[75826]:     </disk>
Nov 16 00:45:08 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:45:08 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:45:08 user nova-compute[75826]:       <source dev="/dev/sdg"/>
Nov 16 00:45:08 user nova-compute[75826]:       <target dev="vdb" bus="virtio"/>
Nov 16 00:45:08 user nova-compute[75826]:       <serial>48b289f4-4b30-4d11-8683-5419d02afa18</serial>
Nov 16 00:45:08 user nova-compute[75826]:     </disk>
Nov 16 00:45:08 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:45:08 user nova-compute[75826]:       <mac address="fa:16:3e:be:0d:c1"/>
Nov 16 00:45:08 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:45:08 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:45:08 user nova-compute[75826]:       <target dev="tap7cb43f66-87"/>
Nov 16 00:45:08 user nova-compute[75826]:     </interface>
Nov 16 00:45:08 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:45:08 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/console.log" append="off"/>
Nov 16 00:45:08 user nova-compute[75826]:     </serial>
Nov 16 00:45:08 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:45:08 user nova-compute[75826]:     <video>
Nov 16 00:45:08 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:45:08 user nova-compute[75826]:     </video>
Nov 16 00:45:08 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:45:08 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:45:08 user nova-compute[75826]:     </rng>
Nov 16 00:45:08 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:45:08 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:45:08 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:45:08 user nova-compute[75826]:     </memballoon>
Nov 16 00:45:08 user nova-compute[75826]:   </devices>
Nov 16 00:45:08 user nova-compute[75826]: </domain>
Nov 16 00:45:08 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-128052432',display_name='tempest-ServerActionsTestOtherB-server-128052432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-128052432',id=4,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXVSxyrOOv945LMuSP1ZSY2bKy/r2ENoqaOk1WP30X55vRshqh2IlMTn2ZQNXytP2IoxEzIDq41/VjnE1Be/JLQH8UoBKnsMheiLtYOBuEJV23nUuMbFcWJ5C5rYTqIuQ==',key_name='tempest-keypair-103688613',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:43:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='150aa3cf14d44a658edb06ade47a2d10',ramdisk_id='',reservation_id='r-tzkzh647',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1007762654',owner_user_name='tempest-ServerActionsTestOtherB-1007762654-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19886e0e1844467785425d17411f9656',uuid=713e6618-89af-47e0-ba5a-4f77cb1d7ff6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converting VIF {"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG os_vif [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a5a7e6b6-f748-50cf-90d8-48efb2e56403', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cb43f66-87, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cb43f66-87, col_values=(('qos', UUID('45860139-431a-45da-a004-453937cb62f5')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cb43f66-87, col_values=(('external_ids', {'iface-id': '7cb43f66-87cf-4cac-85ab-abfe01ff82cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:be:0d:c1', 'vm-uuid': '713e6618-89af-47e0-ba5a-4f77cb1d7ff6'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:08 user nova-compute[75826]: INFO os_vif [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87')
Nov 16 00:45:08 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:45:08 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "d9ac6719-80f7-490a-a51e-869b51118aa2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:09 user nova-compute[75826]: INFO nova.compute.manager [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Terminating instance
Nov 16 00:45:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-219639e4-cf85-444a-aa4e-29ec5f92d792 req-170ac4bc-bd3f-4344-8484-2f1530c3ca8d service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Received event network-vif-unplugged-e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-219639e4-cf85-444a-aa4e-29ec5f92d792 req-170ac4bc-bd3f-4344-8484-2f1530c3ca8d service nova] Acquiring lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-219639e4-cf85-444a-aa4e-29ec5f92d792 req-170ac4bc-bd3f-4344-8484-2f1530c3ca8d service nova] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-219639e4-cf85-444a-aa4e-29ec5f92d792 req-170ac4bc-bd3f-4344-8484-2f1530c3ca8d service nova] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-219639e4-cf85-444a-aa4e-29ec5f92d792 req-170ac4bc-bd3f-4344-8484-2f1530c3ca8d service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] No waiting events found dispatching network-vif-unplugged-e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-219639e4-cf85-444a-aa4e-29ec5f92d792 req-170ac4bc-bd3f-4344-8484-2f1530c3ca8d service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Received event network-vif-unplugged-e7134fec-93d3-43b3-ba14-b08aa94c3cdf for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:45:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:10 user nova-compute[75826]: DEBUG nova.compute.manager [req-5493fd7f-8f6f-4ff2-9913-b753793b04f5 req-b5ec57d4-d2fd-4320-aa0b-5b0cb2fd9abc service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5493fd7f-8f6f-4ff2-9913-b753793b04f5 req-b5ec57d4-d2fd-4320-aa0b-5b0cb2fd9abc service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5493fd7f-8f6f-4ff2-9913-b753793b04f5 req-b5ec57d4-d2fd-4320-aa0b-5b0cb2fd9abc service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5493fd7f-8f6f-4ff2-9913-b753793b04f5 req-b5ec57d4-d2fd-4320-aa0b-5b0cb2fd9abc service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:10 user nova-compute[75826]: DEBUG nova.compute.manager [req-5493fd7f-8f6f-4ff2-9913-b753793b04f5 req-b5ec57d4-d2fd-4320-aa0b-5b0cb2fd9abc service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:10 user nova-compute[75826]: WARNING nova.compute.manager [req-5493fd7f-8f6f-4ff2-9913-b753793b04f5 req-b5ec57d4-d2fd-4320-aa0b-5b0cb2fd9abc service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-950ac11c-60e7-4772-ab1f-51235827d355 for instance with vm_state building and task_state spawning.
Nov 16 00:45:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-78563708-0455-4183-bb84-9747663ec006 req-0c1b4b8b-7ab2-442c-8cfe-6442ba1721e6 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-44813b22-4904-4534-9674-14220b2ee743 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-78563708-0455-4183-bb84-9747663ec006 req-0c1b4b8b-7ab2-442c-8cfe-6442ba1721e6 service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-78563708-0455-4183-bb84-9747663ec006 req-0c1b4b8b-7ab2-442c-8cfe-6442ba1721e6 service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-78563708-0455-4183-bb84-9747663ec006 req-0c1b4b8b-7ab2-442c-8cfe-6442ba1721e6 service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-78563708-0455-4183-bb84-9747663ec006 req-0c1b4b8b-7ab2-442c-8cfe-6442ba1721e6 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-44813b22-4904-4534-9674-14220b2ee743 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:11 user nova-compute[75826]: WARNING nova.compute.manager [req-78563708-0455-4183-bb84-9747663ec006 req-0c1b4b8b-7ab2-442c-8cfe-6442ba1721e6 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-44813b22-4904-4534-9674-14220b2ee743 for instance with vm_state building and task_state spawning.
Nov 16 00:45:11 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Instance destroyed successfully.
Nov 16 00:45:11 user nova-compute[75826]: DEBUG nova.objects.instance [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lazy-loading 'resources' on Instance uuid d9ac6719-80f7-490a-a51e-869b51118aa2 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-556892094',display_name='tempest-VolumesAdminNegativeTest-server-556892094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-556892094',id=5,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9QAaAFTexNEKF5fXTcOL7dNbLmlfaI/OmU9zv4oZhsP+jO/HWOkJKsG7s61B5qJxaZtjjsM9fvMNey6UI/Z/aAR7wugaM4nb8U+jn96M11eVubXv8gU5+dvUNteGxu4g==',key_name='tempest-keypair-1416900899',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f6aa796a8fb4ea79988055543768456',ramdisk_id='',reservation_id='r-5kud78aw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1306204197',owner_user_name='tempest-VolumesAdminNegativeTest-1306204197-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a021a407de284df491fe3dc7b0608403',uuid=d9ac6719-80f7-490a-a51e-869b51118aa2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "address": "fa:16:3e:03:9a:ea", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7134fec-93", "ovs_interfaceid": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Converting VIF {"id": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "address": "fa:16:3e:03:9a:ea", "network": {"id": "141bcbbc-7a5f-4b5d-a251-1dd570355db8", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-328479811-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f6aa796a8fb4ea79988055543768456", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7134fec-93", "ovs_interfaceid": "e7134fec-93d3-43b3-ba14-b08aa94c3cdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:9a:ea,bridge_name='br-int',has_traffic_filtering=True,id=e7134fec-93d3-43b3-ba14-b08aa94c3cdf,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7134fec-93') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG os_vif [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:9a:ea,bridge_name='br-int',has_traffic_filtering=True,id=e7134fec-93d3-43b3-ba14-b08aa94c3cdf,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7134fec-93') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7134fec-93, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-564566cc-427d-47ca-b7a5-5312ef9a94d2 req-1f4695af-5f6f-4daf-a16b-5d949556aee9 service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Received event network-vif-plugged-e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-564566cc-427d-47ca-b7a5-5312ef9a94d2 req-1f4695af-5f6f-4daf-a16b-5d949556aee9 service nova] Acquiring lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-564566cc-427d-47ca-b7a5-5312ef9a94d2 req-1f4695af-5f6f-4daf-a16b-5d949556aee9 service nova] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-564566cc-427d-47ca-b7a5-5312ef9a94d2 req-1f4695af-5f6f-4daf-a16b-5d949556aee9 service nova] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-564566cc-427d-47ca-b7a5-5312ef9a94d2 req-1f4695af-5f6f-4daf-a16b-5d949556aee9 service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] No waiting events found dispatching network-vif-plugged-e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:11 user nova-compute[75826]: WARNING nova.compute.manager [req-564566cc-427d-47ca-b7a5-5312ef9a94d2 req-1f4695af-5f6f-4daf-a16b-5d949556aee9 service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Received unexpected event network-vif-plugged-e7134fec-93d3-43b3-ba14-b08aa94c3cdf for instance with vm_state active and task_state deleting.
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dcb210e5-3a5c-4c37-9aee-72783eb9276d) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:11 user nova-compute[75826]: INFO os_vif [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:9a:ea,bridge_name='br-int',has_traffic_filtering=True,id=e7134fec-93d3-43b3-ba14-b08aa94c3cdf,network=Network(141bcbbc-7a5f-4b5d-a251-1dd570355db8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7134fec-93')
Nov 16 00:45:11 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Deleting instance files /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2_del
Nov 16 00:45:11 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Deletion of /opt/stack/data/nova/instances/d9ac6719-80f7-490a-a51e-869b51118aa2_del complete
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:11 user nova-compute[75826]: INFO nova.compute.manager [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Took 2.81 seconds to destroy the instance on the hypervisor.
Nov 16 00:45:11 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:45:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:12 user nova-compute[75826]: WARNING nova.compute.manager [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-950ac11c-60e7-4772-ab1f-51235827d355 for instance with vm_state building and task_state spawning.
Nov 16 00:45:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-09a45f64-c713-4faf-b030-9a71edc2bfe5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-09a45f64-c713-4faf-b030-9a71edc2bfe5 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:12 user nova-compute[75826]: WARNING nova.compute.manager [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-09a45f64-c713-4faf-b030-9a71edc2bfe5 for instance with vm_state building and task_state spawning.
Nov 16 00:45:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-09a45f64-c713-4faf-b030-9a71edc2bfe5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-09a45f64-c713-4faf-b030-9a71edc2bfe5 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:12 user nova-compute[75826]: WARNING nova.compute.manager [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-09a45f64-c713-4faf-b030-9a71edc2bfe5 for instance with vm_state building and task_state spawning.
Nov 16 00:45:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-3753c6de-ba1a-4839-81db-e9920a6b815f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-3753c6de-ba1a-4839-81db-e9920a6b815f {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:12 user nova-compute[75826]: WARNING nova.compute.manager [req-f68a59fb-8e40-4149-a563-77663f577714 req-46c6f26e-4d09-4498-a92f-87ea39dee34a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-3753c6de-ba1a-4839-81db-e9920a6b815f for instance with vm_state building and task_state spawning.
Nov 16 00:45:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:45:12 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Took 0.94 seconds to deallocate network for instance.
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-3f010ad8-28e6-4b6d-9c07-e63657fab8a2 req-78bb40e2-858c-402e-9910-188a7684d96d service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-44813b22-4904-4534-9674-14220b2ee743 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3f010ad8-28e6-4b6d-9c07-e63657fab8a2 req-78bb40e2-858c-402e-9910-188a7684d96d service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3f010ad8-28e6-4b6d-9c07-e63657fab8a2 req-78bb40e2-858c-402e-9910-188a7684d96d service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3f010ad8-28e6-4b6d-9c07-e63657fab8a2 req-78bb40e2-858c-402e-9910-188a7684d96d service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-3f010ad8-28e6-4b6d-9c07-e63657fab8a2 req-78bb40e2-858c-402e-9910-188a7684d96d service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-44813b22-4904-4534-9674-14220b2ee743 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:13 user nova-compute[75826]: WARNING nova.compute.manager [req-3f010ad8-28e6-4b6d-9c07-e63657fab8a2 req-78bb40e2-858c-402e-9910-188a7684d96d service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-44813b22-4904-4534-9674-14220b2ee743 for instance with vm_state building and task_state spawning.
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-3f010ad8-28e6-4b6d-9c07-e63657fab8a2 req-78bb40e2-858c-402e-9910-188a7684d96d service nova] [instance: d9ac6719-80f7-490a-a51e-869b51118aa2] Received event network-vif-deleted-e7134fec-93d3-43b3-ba14-b08aa94c3cdf {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xudMsJbB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:45:13 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:45:13 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:45:13 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:45:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab3211c-3258-4a3d-8d61-daaf9868ffa5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:45:13 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.084s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2406d5e-de22-432f-85e5-80c888e4acdc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c] added
Nov 16 00:45:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[24de0464-7683-44a9-badb-3d278e111d51]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6eb4ca-4b56-4620-ae6f-c40714a4e3c6]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xudMsJbB {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.710s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xudMsJbB" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b356986-7ffa-4e11-85ca-f9b6bd95e5e7]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xudMsJbB'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4402f7c7-1713-4dff-bcb8-d159e656b7f3]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:13 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Deleted allocations for instance d9ac6719-80f7-490a-a51e-869b51118aa2
Nov 16 00:45:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f74d4a-fa37-4518-8250-b136767f5af8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] No waiting events found dispatching network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:13 user nova-compute[75826]: WARNING nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received unexpected event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc for instance with vm_state resized and task_state resize_reverting.
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] No waiting events found dispatching network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:13 user nova-compute[75826]: WARNING nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received unexpected event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc for instance with vm_state resized and task_state resize_reverting.
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-5f1e8fd9-8c1e-4815-9320-fe039c91101f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-5f1e8fd9-8c1e-4815-9320-fe039c91101f {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:13 user nova-compute[75826]: WARNING nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-5f1e8fd9-8c1e-4815-9320-fe039c91101f for instance with vm_state building and task_state spawning.
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-5f1e8fd9-8c1e-4815-9320-fe039c91101f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-5f1e8fd9-8c1e-4815-9320-fe039c91101f {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:13 user nova-compute[75826]: WARNING nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-5f1e8fd9-8c1e-4815-9320-fe039c91101f for instance with vm_state building and task_state spawning.
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-d9656c82-57df-4891-9c78-531de3f2c5aa {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-d9656c82-57df-4891-9c78-531de3f2c5aa {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:13 user nova-compute[75826]: WARNING nova.compute.manager [req-376003fd-a75e-4b37-89b4-f44776f1ec0a req-3818d9cd-9b48-41d8-9d8d-9001dfd3a54a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-d9656c82-57df-4891-9c78-531de3f2c5aa for instance with vm_state building and task_state spawning.
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b67f8f35-5858-4e50-8818-83d2809bec38 tempest-VolumesAdminNegativeTest-1306204197 tempest-VolumesAdminNegativeTest-1306204197-project-member] Lock "d9ac6719-80f7-490a-a51e-869b51118aa2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.679s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7b06dd-95ad-45d1-8b1c-7e60d4ca1b0c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260]
Nov 16 00:45:13 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260] successful.
Nov 16 00:45:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5b664d-b4e2-497f-86e0-8c72235d7e0f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d8902b-2bd9-4dc6-9b44-266188d041bc]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:45:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:45:13 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:45:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.499s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] HCTL ('39', '-', '-', 0) found on session 23 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c1dfcf0-1c21-4d90-a1c8-be58977186ec]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Searching for a device in session 23 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:45:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xudMsJbB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-b765a26a-a28f-4ec4-b920-1dc5a7231939 req-af6c0002-27d6-4134-922d-b96cfdcb7f3c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-3753c6de-ba1a-4839-81db-e9920a6b815f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b765a26a-a28f-4ec4-b920-1dc5a7231939 req-af6c0002-27d6-4134-922d-b96cfdcb7f3c service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b765a26a-a28f-4ec4-b920-1dc5a7231939 req-af6c0002-27d6-4134-922d-b96cfdcb7f3c service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b765a26a-a28f-4ec4-b920-1dc5a7231939 req-af6c0002-27d6-4134-922d-b96cfdcb7f3c service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-b765a26a-a28f-4ec4-b920-1dc5a7231939 req-af6c0002-27d6-4134-922d-b96cfdcb7f3c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-3753c6de-ba1a-4839-81db-e9920a6b815f {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:14 user nova-compute[75826]: WARNING nova.compute.manager [req-b765a26a-a28f-4ec4-b920-1dc5a7231939 req-af6c0002-27d6-4134-922d-b96cfdcb7f3c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-3753c6de-ba1a-4839-81db-e9920a6b815f for instance with vm_state building and task_state spawning.
Nov 16 00:45:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.537s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] <== connect_volume: return (1539ms) {'type': 'block', 'scsi_wwn': '23961316538346362', 'path': '/dev/sdh'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961316538346362', 'path': '/dev/sdh'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG nova.objects.instance [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'flavor' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:45:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:45:14 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:45:14 user nova-compute[75826]:   <source dev="/dev/sdh"/>
Nov 16 00:45:14 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:45:14 user nova-compute[75826]:   <serial>614386b6-09ef-4bd9-b7ff-475392da7e4c</serial>
Nov 16 00:45:14 user nova-compute[75826]: </disk>
Nov 16 00:45:14 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No VIF found with MAC fa:16:3e:fc:58:e0, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-de668551-2e24-4390-9446-391dc5c0561b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.863s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-d9656c82-57df-4891-9c78-531de3f2c5aa {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-d9656c82-57df-4891-9c78-531de3f2c5aa {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:15 user nova-compute[75826]: WARNING nova.compute.manager [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-d9656c82-57df-4891-9c78-531de3f2c5aa for instance with vm_state building and task_state spawning.
Nov 16 00:45:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-605e5626-2a1e-4c78-8781-6bfd370354af {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-605e5626-2a1e-4c78-8781-6bfd370354af {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:15 user nova-compute[75826]: WARNING nova.compute.manager [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-605e5626-2a1e-4c78-8781-6bfd370354af for instance with vm_state building and task_state spawning.
Nov 16 00:45:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-605e5626-2a1e-4c78-8781-6bfd370354af {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-605e5626-2a1e-4c78-8781-6bfd370354af {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:15 user nova-compute[75826]: WARNING nova.compute.manager [req-0a97cd7c-70a4-4ceb-9ba8-556096aeb750 req-ab2693b7-b632-41b1-aa64-8cb018eaf7ff service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-605e5626-2a1e-4c78-8781-6bfd370354af for instance with vm_state building and task_state spawning.
Nov 16 00:45:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:45:15 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Instance running successfully.
Nov 16 00:45:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] finish_revert_migration finished successfully. {{(pid=75826) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 16 00:45:16 user nova-compute[75826]: INFO nova.compute.manager [None req-c261bbbc-af8e-4902-a483-f74dc2df509a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating instance to original state: 'active'
Nov 16 00:45:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:45:16 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Instance spawned successfully.
Nov 16 00:45:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:45:16 user nova-compute[75826]: INFO nova.compute.manager [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Took 18.03 seconds to spawn the instance on the hypervisor.
Nov 16 00:45:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:45:16 user nova-compute[75826]: INFO nova.compute.manager [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Took 36.62 seconds to build instance.
Nov 16 00:45:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d325ad1d-457f-4bfc-a97e-176bb9b906ea tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 36.717s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a7af2c7b-8975-4906-8ea7-bc9b90f98e2e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a7af2c7b-8975-4906-8ea7-bc9b90f98e2e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a7af2c7b-8975-4906-8ea7-bc9b90f98e2e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a7af2c7b-8975-4906-8ea7-bc9b90f98e2e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75826) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG nova.objects.instance [None req-a7af2c7b-8975-4906-8ea7-bc9b90f98e2e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'flavor' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-f36fa0b7-efeb-4ec9-ae88-d4f2fc7e6c0e req-e5ee683d-d3f4-4c52-8190-436936588f52 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-unplugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f36fa0b7-efeb-4ec9-ae88-d4f2fc7e6c0e req-e5ee683d-d3f4-4c52-8190-436936588f52 service nova] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f36fa0b7-efeb-4ec9-ae88-d4f2fc7e6c0e req-e5ee683d-d3f4-4c52-8190-436936588f52 service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f36fa0b7-efeb-4ec9-ae88-d4f2fc7e6c0e req-e5ee683d-d3f4-4c52-8190-436936588f52 service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-f36fa0b7-efeb-4ec9-ae88-d4f2fc7e6c0e req-e5ee683d-d3f4-4c52-8190-436936588f52 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] No waiting events found dispatching network-vif-unplugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:17 user nova-compute[75826]: WARNING nova.compute.manager [req-f36fa0b7-efeb-4ec9-ae88-d4f2fc7e6c0e req-e5ee683d-d3f4-4c52-8190-436936588f52 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received unexpected event network-vif-unplugged-ff64782d-047b-4488-80c5-b8866a0c5037 for instance with vm_state active and task_state powering-off.
Nov 16 00:45:17 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Instance destroyed successfully.
Nov 16 00:45:17 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a7af2c7b-8975-4906-8ea7-bc9b90f98e2e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:45:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a7af2c7b-8975-4906-8ea7-bc9b90f98e2e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.922s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:19 user nova-compute[75826]: DEBUG nova.compute.manager [req-2124e957-2973-483c-9aa4-93940798f571 req-e294f46b-07f5-4dff-976f-1c1a9cc8c5be service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2124e957-2973-483c-9aa4-93940798f571 req-e294f46b-07f5-4dff-976f-1c1a9cc8c5be service nova] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2124e957-2973-483c-9aa4-93940798f571 req-e294f46b-07f5-4dff-976f-1c1a9cc8c5be service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2124e957-2973-483c-9aa4-93940798f571 req-e294f46b-07f5-4dff-976f-1c1a9cc8c5be service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:19 user nova-compute[75826]: DEBUG nova.compute.manager [req-2124e957-2973-483c-9aa4-93940798f571 req-e294f46b-07f5-4dff-976f-1c1a9cc8c5be service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] No waiting events found dispatching network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:19 user nova-compute[75826]: WARNING nova.compute.manager [req-2124e957-2973-483c-9aa4-93940798f571 req-e294f46b-07f5-4dff-976f-1c1a9cc8c5be service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received unexpected event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 for instance with vm_state stopped and task_state None.
Nov 16 00:45:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-2a136d3f-332c-4711-8533-8160c27bb8fc req-ab0b08b5-5fc3-43d2-8886-89fa07e6e808 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Received event network-changed-9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-2a136d3f-332c-4711-8533-8160c27bb8fc req-ab0b08b5-5fc3-43d2-8886-89fa07e6e808 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Refreshing instance network info cache due to event network-changed-9eca4e57-6005-41bb-b05b-3fb5793ffc88. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:45:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2a136d3f-332c-4711-8533-8160c27bb8fc req-ab0b08b5-5fc3-43d2-8886-89fa07e6e808 service nova] Acquiring lock "refresh_cache-eeb0e320-431c-44ad-bbb9-3eda75234ed1" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:45:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2a136d3f-332c-4711-8533-8160c27bb8fc req-ab0b08b5-5fc3-43d2-8886-89fa07e6e808 service nova] Acquired lock "refresh_cache-eeb0e320-431c-44ad-bbb9-3eda75234ed1" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:45:40 user nova-compute[75826]: DEBUG nova.network.neutron [req-2a136d3f-332c-4711-8533-8160c27bb8fc req-ab0b08b5-5fc3-43d2-8886-89fa07e6e808 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Refreshing network info cache for port 9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-2a136d3f-332c-4711-8533-8160c27bb8fc req-ab0b08b5-5fc3-43d2-8886-89fa07e6e808 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Updated VIF entry in instance network info cache for port 9eca4e57-6005-41bb-b05b-3fb5793ffc88. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-2a136d3f-332c-4711-8533-8160c27bb8fc req-ab0b08b5-5fc3-43d2-8886-89fa07e6e808 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Updating instance_info_cache with network_info: [{"id": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "address": "fa:16:3e:a9:78:21", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4e57-60", "ovs_interfaceid": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2a136d3f-332c-4711-8533-8160c27bb8fc req-ab0b08b5-5fc3-43d2-8886-89fa07e6e808 service nova] Releasing lock "refresh_cache-eeb0e320-431c-44ad-bbb9-3eda75234ed1" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG nova.objects.instance [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lazy-loading 'flavor' on Instance uuid eeb0e320-431c-44ad-bbb9-3eda75234ed1 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:41 user nova-compute[75826]: INFO nova.compute.manager [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Attaching volume bab54e8c-de99-487e-afde-31912b4a0c41 to /dev/vdb
Nov 16 00:45:41 user nova-compute[75826]: DEBUG os_brick.utils [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c244105f-d4ed-4153-9053-5ac56ceceb33]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26df4b3-b43c-4a3a-8c99-a8e6cb183187]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[078db527-c762-4345-9214-a3deb39e3749]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b00994f-b036-4f9a-801c-424a715b091c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:45:41 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:45:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1351d231-3bdb-4cd3-ad3d-4fe89774bbae]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG os_brick.utils [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:45:41 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Updating existing volume attachment record: 8f4b1593-dfea-47cc-bca3-2c6d942e13d0 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:45:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:45 user nova-compute[75826]: INFO nova.compute.manager [None req-120e4b3b-2fac-4998-a221-f161c2e9ea72 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Unrescuing
Nov 16 00:45:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-120e4b3b-2fac-4998-a221-f161c2e9ea72 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:45:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-120e4b3b-2fac-4998-a221-f161c2e9ea72 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquired lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:45:45 user nova-compute[75826]: DEBUG nova.network.neutron [None req-120e4b3b-2fac-4998-a221-f161c2e9ea72 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG nova.network.neutron [None req-120e4b3b-2fac-4998-a221-f161c2e9ea72 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Updating instance_info_cache with network_info: [{"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-120e4b3b-2fac-4998-a221-f161c2e9ea72 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Releasing lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG nova.objects.instance [None req-120e4b3b-2fac-4998-a221-f161c2e9ea72 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'flavor' on Instance uuid 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-1ddea8f4-c55f-4ece-a4ec-5c3fae15b829 req-6f3ca4f7-da83-493c-a54a-1bd7cc541314 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-unplugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1ddea8f4-c55f-4ece-a4ec-5c3fae15b829 req-6f3ca4f7-da83-493c-a54a-1bd7cc541314 service nova] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1ddea8f4-c55f-4ece-a4ec-5c3fae15b829 req-6f3ca4f7-da83-493c-a54a-1bd7cc541314 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1ddea8f4-c55f-4ece-a4ec-5c3fae15b829 req-6f3ca4f7-da83-493c-a54a-1bd7cc541314 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-1ddea8f4-c55f-4ece-a4ec-5c3fae15b829 req-6f3ca4f7-da83-493c-a54a-1bd7cc541314 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] No waiting events found dispatching network-vif-unplugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:46 user nova-compute[75826]: WARNING nova.compute.manager [req-1ddea8f4-c55f-4ece-a4ec-5c3fae15b829 req-6f3ca4f7-da83-493c-a54a-1bd7cc541314 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received unexpected event network-vif-unplugged-9a741ee6-00d4-49d0-8562-3ece777615c8 for instance with vm_state rescued and task_state unrescuing.
Nov 16 00:45:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zixyBgAc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:45:46 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:45:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:45:46 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:45:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:45:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:45:46 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:45:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b30beb5-05d5-4c43-ac58-11bb1a6caaaf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:45:47 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[061ff75a-23ac-4b34-8da4-02dd89528ee5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41] added
Nov 16 00:45:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Instance destroyed successfully.
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[be647588-90a5-4f2b-b15e-cf381720ff38]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3640b467-2c77-42c5-a7b8-bc42cbb7835f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zixyBgAc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zixyBgAc" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2090d545-238b-4b86-b961-d1c606961c92]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zixyBgAc'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9596fc0b-b9ab-446f-bd30-8ef74755c1d1]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe300aa-c012-476a-8a60-15018bbcf835]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:45:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:45:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cbb96f-57ba-4840-93bb-e0df6fbfbc03]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41, portal: 172.16.0.220,3260]
Nov 16 00:45:47 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41, portal: 172.16.0.220,3260] successful.
Nov 16 00:45:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[87f5c82f-e080-4d01-8d7c-3c940afc2ae9]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b791d00-cbd6-42f6-90bc-aa36f0bc8268]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:45:47 user nova-compute[75826]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 (non-flash)
Nov 16 00:45:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] HCTL ('40', '-', '-', 0) found on session 24 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02e5119-fa32-4e29-a77b-ac142dfc991b]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:45:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Searching for a device in session 24 and hctl ['40', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Searching for a device in session 24 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zixyBgAc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23966363664613062', 'path': '/dev/sdi'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966363664613062', 'path': '/dev/sdi'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG nova.objects.instance [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lazy-loading 'flavor' on Instance uuid eeb0e320-431c-44ad-bbb9-3eda75234ed1 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:45:48 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:45:48 user nova-compute[75826]:   <source dev="/dev/sdi"/>
Nov 16 00:45:48 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:45:48 user nova-compute[75826]:   <serial>bab54e8c-de99-487e-afde-31912b4a0c41</serial>
Nov 16 00:45:48 user nova-compute[75826]: </disk>
Nov 16 00:45:48 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-618c6fed-f326-4f8d-8a6b-3b9de77a3ea4 req-333ac300-c2d3-4857-b371-7e3989bd01b7 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-618c6fed-f326-4f8d-8a6b-3b9de77a3ea4 req-333ac300-c2d3-4857-b371-7e3989bd01b7 service nova] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-618c6fed-f326-4f8d-8a6b-3b9de77a3ea4 req-333ac300-c2d3-4857-b371-7e3989bd01b7 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-618c6fed-f326-4f8d-8a6b-3b9de77a3ea4 req-333ac300-c2d3-4857-b371-7e3989bd01b7 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-618c6fed-f326-4f8d-8a6b-3b9de77a3ea4 req-333ac300-c2d3-4857-b371-7e3989bd01b7 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] No waiting events found dispatching network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:48 user nova-compute[75826]: WARNING nova.compute.manager [req-618c6fed-f326-4f8d-8a6b-3b9de77a3ea4 req-333ac300-c2d3-4857-b371-7e3989bd01b7 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received unexpected event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 for instance with vm_state rescued and task_state unrescuing.
Nov 16 00:45:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-618c6fed-f326-4f8d-8a6b-3b9de77a3ea4 req-333ac300-c2d3-4857-b371-7e3989bd01b7 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-618c6fed-f326-4f8d-8a6b-3b9de77a3ea4 req-333ac300-c2d3-4857-b371-7e3989bd01b7 service nova] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-618c6fed-f326-4f8d-8a6b-3b9de77a3ea4 req-333ac300-c2d3-4857-b371-7e3989bd01b7 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-618c6fed-f326-4f8d-8a6b-3b9de77a3ea4 req-333ac300-c2d3-4857-b371-7e3989bd01b7 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-618c6fed-f326-4f8d-8a6b-3b9de77a3ea4 req-333ac300-c2d3-4857-b371-7e3989bd01b7 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] No waiting events found dispatching network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:48 user nova-compute[75826]: WARNING nova.compute.manager [req-618c6fed-f326-4f8d-8a6b-3b9de77a3ea4 req-333ac300-c2d3-4857-b371-7e3989bd01b7 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received unexpected event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 for instance with vm_state rescued and task_state unrescuing.
Nov 16 00:45:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:45:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:45:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] No VIF found with MAC fa:16:3e:a9:78:21, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:45:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8c506708-86db-486e-9019-91f03c0c7df6 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.549s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-6f62de02-e6d5-4c40-b8ed-71b2408d50f2 req-2925770a-d31c-401c-adf9-0eb9fbc374e7 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:45:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6f62de02-e6d5-4c40-b8ed-71b2408d50f2 req-2925770a-d31c-401c-adf9-0eb9fbc374e7 service nova] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6f62de02-e6d5-4c40-b8ed-71b2408d50f2 req-2925770a-d31c-401c-adf9-0eb9fbc374e7 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6f62de02-e6d5-4c40-b8ed-71b2408d50f2 req-2925770a-d31c-401c-adf9-0eb9fbc374e7 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-6f62de02-e6d5-4c40-b8ed-71b2408d50f2 req-2925770a-d31c-401c-adf9-0eb9fbc374e7 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] No waiting events found dispatching network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:45:50 user nova-compute[75826]: WARNING nova.compute.manager [req-6f62de02-e6d5-4c40-b8ed-71b2408d50f2 req-2925770a-d31c-401c-adf9-0eb9fbc374e7 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received unexpected event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 for instance with vm_state rescued and task_state unrescuing.
Nov 16 00:45:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-120e4b3b-2fac-4998-a221-f161c2e9ea72 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:45:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:51 user nova-compute[75826]: INFO nova.compute.manager [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Detaching volume bab54e8c-de99-487e-afde-31912b4a0c41
Nov 16 00:45:51 user nova-compute[75826]: INFO nova.virt.block_device [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Attempting to driver detach volume bab54e8c-de99-487e-afde-31912b4a0c41 from mountpoint /dev/vdb
Nov 16 00:45:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Attempting to detach device vdb from instance eeb0e320-431c-44ad-bbb9-3eda75234ed1 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:45:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:45:51 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:45:51 user nova-compute[75826]:   <source dev="/dev/sdi"/>
Nov 16 00:45:51 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:45:51 user nova-compute[75826]:   <serial>bab54e8c-de99-487e-afde-31912b4a0c41</serial>
Nov 16 00:45:51 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:45:51 user nova-compute[75826]: </disk>
Nov 16 00:45:51 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:45:51 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Successfully detached device vdb from instance eeb0e320-431c-44ad-bbb9-3eda75234ed1 from the persistent domain config.
Nov 16 00:45:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance eeb0e320-431c-44ad-bbb9-3eda75234ed1 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:45:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:45:51 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:45:51 user nova-compute[75826]:   <source dev="/dev/sdi"/>
Nov 16 00:45:51 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:45:51 user nova-compute[75826]:   <serial>bab54e8c-de99-487e-afde-31912b4a0c41</serial>
Nov 16 00:45:51 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:45:51 user nova-compute[75826]: </disk>
Nov 16 00:45:51 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:45:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance eeb0e320-431c-44ad-bbb9-3eda75234ed1 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:45:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 13b9b8b9-6ab1-4a8a-853f-00769b543743 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid eeb0e320-431c-44ad-bbb9-3eda75234ed1 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 7c67f025-987e-435c-b1d9-7936832fe72b {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 1621d261-aa12-4e57-a74e-fe565d921320 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 535e7401-0fb4-4e12-9110-515c63fd32c0 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 5be68126-c125-441d-8f82-4c474b7ce768 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "13b9b8b9-6ab1-4a8a-853f-00769b543743" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "7c67f025-987e-435c-b1d9-7936832fe72b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "1621d261-aa12-4e57-a74e-fe565d921320" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "1621d261-aa12-4e57-a74e-fe565d921320" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "5be68126-c125-441d-8f82-4c474b7ce768" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:45:56 user nova-compute[75826]: WARNING oslo_messaging._drivers.amqpdriver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "5be68126-c125-441d-8f82-4c474b7ce768" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "1621d261-aa12-4e57-a74e-fe565d921320" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.094s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.105s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:45:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:45:57 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:45:59 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:45:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG nova.objects.instance [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lazy-loading 'info_cache' on Instance uuid 13b9b8b9-6ab1-4a8a-853f-00769b543743 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:00 user nova-compute[75826]: INFO nova.compute.manager [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Unshelving
Nov 16 00:46:00 user nova-compute[75826]: INFO nova.virt.block_device [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Booting with volume dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea at /dev/vdc
Nov 16 00:46:00 user nova-compute[75826]: DEBUG os_brick.utils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[51447aed-5237-4c24-a5bf-28562baa825e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba57f757-4bf6-4201-9716-56a2e0dc7c26]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba31604-0993-49d5-980b-38b7664f849d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dac404-9b1a-49c2-b0ce-6d96dff13d5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:46:01 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[833f3980-94a4-4b4e-804a-f149e5767517]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG os_brick.utils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updating existing volume attachment record: 9b72d212-4581-474b-86f8-91237b789724 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Updating instance_info_cache with network_info: [{"id": "378f1586-075a-47fc-8723-540896093fe4", "address": "fa:16:3e:7d:d3:79", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378f1586-07", "ovs_interfaceid": "378f1586-075a-47fc-8723-540896093fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:46:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:46:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:46:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-77aa2e84-9513-4b7a-baa3-b6585e969af8 req-389147f2-1b27-432d-ad33-c7d39be55f3c service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Received event network-changed-b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-77aa2e84-9513-4b7a-baa3-b6585e969af8 req-389147f2-1b27-432d-ad33-c7d39be55f3c service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Refreshing instance network info cache due to event network-changed-b5701d2a-63a8-4968-bec1-7aa295b81b60. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-77aa2e84-9513-4b7a-baa3-b6585e969af8 req-389147f2-1b27-432d-ad33-c7d39be55f3c service nova] Acquiring lock "refresh_cache-7c67f025-987e-435c-b1d9-7936832fe72b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-77aa2e84-9513-4b7a-baa3-b6585e969af8 req-389147f2-1b27-432d-ad33-c7d39be55f3c service nova] Acquired lock "refresh_cache-7c67f025-987e-435c-b1d9-7936832fe72b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.network.neutron [req-77aa2e84-9513-4b7a-baa3-b6585e969af8 req-389147f2-1b27-432d-ad33-c7d39be55f3c service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Refreshing network info cache for port b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "7c67f025-987e-435c-b1d9-7936832fe72b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:05 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:46:05 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7096MB free_disk=25.267162322998047GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lazy-loading 'flavor' on Instance uuid 7c67f025-987e-435c-b1d9-7936832fe72b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 298c8986-b91b-4f46-bcce-75e28bc02b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance eeb0e320-431c-44ad-bbb9-3eda75234ed1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7c67f025-987e-435c-b1d9-7936832fe72b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 1621d261-aa12-4e57-a74e-fe565d921320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 535e7401-0fb4-4e12-9110-515c63fd32c0 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 5be68126-c125-441d-8f82-4c474b7ce768 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "7c67f025-987e-435c-b1d9-7936832fe72b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:05 user nova-compute[75826]: INFO nova.compute.manager [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Attaching volume 628626d1-3245-4dbc-983e-72c3f1f3a39b to /dev/vdb
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG os_brick.utils [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[264cc524-b585-4c64-b1ec-4783143aa0f5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[510b637a-e6ae-4685-89a5-47f804e5c2e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e22abb-bb9e-4c47-b9c8-2bf6f7af60ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2b04f6-a978-4676-88c4-4f433b3d9348]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG nova.network.neutron [req-77aa2e84-9513-4b7a-baa3-b6585e969af8 req-389147f2-1b27-432d-ad33-c7d39be55f3c service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Updated VIF entry in instance network info cache for port b5701d2a-63a8-4968-bec1-7aa295b81b60. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG nova.network.neutron [req-77aa2e84-9513-4b7a-baa3-b6585e969af8 req-389147f2-1b27-432d-ad33-c7d39be55f3c service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Updating instance_info_cache with network_info: [{"id": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "address": "fa:16:3e:5c:fa:48", "network": {"id": "536b4ba3-0a32-4ae8-b94b-f095d82c8d9e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1917941408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "288f933627b44a62b64e093c6a57d6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5701d2a-63", "ovs_interfaceid": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-77aa2e84-9513-4b7a-baa3-b6585e969af8 req-389147f2-1b27-432d-ad33-c7d39be55f3c service nova] Releasing lock "refresh_cache-7c67f025-987e-435c-b1d9-7936832fe72b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:46:06 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:46:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9660ea-d610-455f-91ad-b8f7691dd042]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG os_brick.utils [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Updating existing volume attachment record: cff68849-0e20-4c63-b031-cfe1473cf733 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.717s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG nova.objects.instance [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'pci_requests' on Instance uuid 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG nova.objects.instance [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'numa_topology' on Instance uuid 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:06 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:46:06 user nova-compute[75826]: INFO nova.compute.claims [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Claim successful on node user
Nov 16 00:46:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:07 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:46:07 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:46:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:07 user nova-compute[75826]: INFO nova.network.neutron [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updating port 29ee5e10-3912-41da-a701-c5034a67f421 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquired lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG nova.network.neutron [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG nova.compute.manager [req-852e74f2-34a6-4fc7-ab97-2dfcfd65672d req-3cff437f-8b0f-46bc-af53-dc94e276753e service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-changed-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG nova.compute.manager [req-852e74f2-34a6-4fc7-ab97-2dfcfd65672d req-3cff437f-8b0f-46bc-af53-dc94e276753e service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Refreshing instance network info cache due to event network-changed-29ee5e10-3912-41da-a701-c5034a67f421. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-852e74f2-34a6-4fc7-ab97-2dfcfd65672d req-3cff437f-8b0f-46bc-af53-dc94e276753e service nova] Acquiring lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG nova.network.neutron [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updating instance_info_cache with network_info: [{"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Releasing lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:46:08 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Creating image(s)
Nov 16 00:46:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "/opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "/opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG nova.objects.instance [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-852e74f2-34a6-4fc7-ab97-2dfcfd65672d req-3cff437f-8b0f-46bc-af53-dc94e276753e service nova] Acquired lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG nova.network.neutron [req-852e74f2-34a6-4fc7-ab97-2dfcfd65672d req-3cff437f-8b0f-46bc-af53-dc94e276753e service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Refreshing network info cache for port 29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG nova.objects.base [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Object Instance<5fdf32cf-b23f-4b65-8a47-1cf913b950d9> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "467a67a710dbb1a1a2e761dfdce39019c0fe8885" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "467a67a710dbb1a1a2e761dfdce39019c0fe8885" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885.part --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885.part --force-share --output=json" returned: 0 in 0.205s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG nova.virt.images [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] f71807b8-2b40-473b-880f-4c850d3bcec8 was qcow2, converting to raw {{(pid=75826) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885.part /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885.converted {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG nova.compute.manager [req-e38e5405-440e-4fd6-af48-c4fbeeefa9ae req-d51f3a63-5cf6-49f2-acf1-22cc875c745c service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Received event network-changed-8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG nova.compute.manager [req-e38e5405-440e-4fd6-af48-c4fbeeefa9ae req-d51f3a63-5cf6-49f2-acf1-22cc875c745c service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Refreshing instance network info cache due to event network-changed-8b853c2c-b02a-49c8-a6a4-76106e6b2228. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e38e5405-440e-4fd6-af48-c4fbeeefa9ae req-d51f3a63-5cf6-49f2-acf1-22cc875c745c service nova] Acquiring lock "refresh_cache-1621d261-aa12-4e57-a74e-fe565d921320" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e38e5405-440e-4fd6-af48-c4fbeeefa9ae req-d51f3a63-5cf6-49f2-acf1-22cc875c745c service nova] Acquired lock "refresh_cache-1621d261-aa12-4e57-a74e-fe565d921320" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-e38e5405-440e-4fd6-af48-c4fbeeefa9ae req-d51f3a63-5cf6-49f2-acf1-22cc875c745c service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Refreshing network info cache for port 8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-852e74f2-34a6-4fc7-ab97-2dfcfd65672d req-3cff437f-8b0f-46bc-af53-dc94e276753e service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updated VIF entry in instance network info cache for port 29ee5e10-3912-41da-a701-c5034a67f421. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-852e74f2-34a6-4fc7-ab97-2dfcfd65672d req-3cff437f-8b0f-46bc-af53-dc94e276753e service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updating instance_info_cache with network_info: [{"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-852e74f2-34a6-4fc7-ab97-2dfcfd65672d req-3cff437f-8b0f-46bc-af53-dc94e276753e service nova] Releasing lock "refresh_cache-5fdf32cf-b23f-4b65-8a47-1cf913b950d9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885.part /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885.converted" returned: 0 in 0.615s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885.converted --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-e38e5405-440e-4fd6-af48-c4fbeeefa9ae req-d51f3a63-5cf6-49f2-acf1-22cc875c745c service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Updated VIF entry in instance network info cache for port 8b853c2c-b02a-49c8-a6a4-76106e6b2228. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:46:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-e38e5405-440e-4fd6-af48-c4fbeeefa9ae req-d51f3a63-5cf6-49f2-acf1-22cc875c745c service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Updating instance_info_cache with network_info: [{"id": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "address": "fa:16:3e:5f:1e:f8", "network": {"id": "637cf6bb-6dcf-437b-a8e5-77e95b66185e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422833898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d405b224d90942d6bd3188f6df34dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853c2c-b0", "ovs_interfaceid": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885.converted --force-share --output=json" returned: 0 in 0.215s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "467a67a710dbb1a1a2e761dfdce39019c0fe8885" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.413s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885 --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e38e5405-440e-4fd6-af48-c4fbeeefa9ae req-d51f3a63-5cf6-49f2-acf1-22cc875c745c service nova] Releasing lock "refresh_cache-1621d261-aa12-4e57-a74e-fe565d921320" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885 --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "467a67a710dbb1a1a2e761dfdce39019c0fe8885" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "467a67a710dbb1a1a2e761dfdce39019c0fe8885" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885 --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885 --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885,backing_fmt=raw /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885,backing_fmt=raw /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk 1073741824" returned: 0 in 0.050s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "467a67a710dbb1a1a2e761dfdce39019c0fe8885" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885 --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885 --force-share --output=json" returned: 0 in 0.210s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG nova.objects.instance [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'migration_context' on Instance uuid 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG nova.objects.base [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Object Instance<5fdf32cf-b23f-4b65-8a47-1cf913b950d9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:46:11 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Rebasing disk image.
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBykUMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:11 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:11 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:11 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[39747ca2-7672-4154-b62f-fbc667100fa4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:46:11 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0017ab-046d-43a4-9ff4-743644661e74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b] added
Nov 16 00:46:11 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcb2124-c9ab-4127-88dd-c89a1b76e82f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8ddcd2-1175-4925-af48-4e0f177bc115]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBykUMID {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:11 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance eeb0e320-431c-44ad-bbb9-3eda75234ed1 is timed out.
Nov 16 00:46:11 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Successfully detached device vdb from instance eeb0e320-431c-44ad-bbb9-3eda75234ed1 from the live domain config.
Nov 16 00:46:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zixyBgAc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:11 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.199s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e -F raw /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBykUMID" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce86bae-8535-4ddb-9c1d-8f76168739ff]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cBykUMID'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[851ce2fe-7153-4e2d-86de-75eb2bc73022]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a74c513-205e-489b-99af-da1fabaf505f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 (non-flash)
Nov 16 00:46:11 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:11 user nova-compute[75826]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 (non-flash)
Nov 16 00:46:11 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a6bef1-6d37-42fb-9d99-2c75e96b1eb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260]
Nov 16 00:46:12 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260] successful.
Nov 16 00:46:12 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[efab2e97-8b2a-4792-a55b-60ffd891d3d6]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf2f0db-aeb9-4285-ad7a-0321c5332794]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:12 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 (non-flash)
Nov 16 00:46:12 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:12 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] HCTL ('41', '-', '-', 0) found on session 25 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[be6af3d9-2319-4dee-a9f3-1164c6501576]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Searching for a device in session 25 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:46:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBykUMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.453s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '23439623262316330', 'path': '/dev/sdj'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439623262316330', 'path': '/dev/sdj'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.338s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lazy-loading 'flavor' on Instance uuid 7c67f025-987e-435c-b1d9-7936832fe72b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.040s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[54af9212-3a54-45e6-999f-419fa991f37d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:46:13 user nova-compute[75826]: No targets found.
Nov 16 00:46:13 user nova-compute[75826]: iSNS:
Nov 16 00:46:13 user nova-compute[75826]: No targets found.
Nov 16 00:46:13 user nova-compute[75826]: STATIC:
Nov 16 00:46:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:46:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a
Nov 16 00:46:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:46:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3
Nov 16 00:46:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:46:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b
Nov 16 00:46:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41
Nov 16 00:46:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:46:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a
Nov 16 00:46:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:13 user nova-compute[75826]: FIRMWARE:
Nov 16 00:46:13 user nova-compute[75826]: No targets found.
Nov 16 00:46:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:46:13 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:46:13 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:46:13 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:46:13 user nova-compute[75826]:   <source dev="/dev/sdj"/>
Nov 16 00:46:13 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:46:13 user nova-compute[75826]:   <serial>628626d1-3245-4dbc-983e-72c3f1f3a39b</serial>
Nov 16 00:46:13 user nova-compute[75826]: </disk>
Nov 16 00:46:13 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.075s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c037b1f-1bf2-4f55-ad18-99f50a44ad56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3df5f1-c61a-4758-8fa1-3c9a74cae7aa]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 (non-flash)
Nov 16 00:46:13 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdbc0c9c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41'): ({'sdi'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Removing single pathed devices sdi {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[139ff78a-642b-4121-843d-c2e16a848b73]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe8bae7-49ec-476e-bdd9-c461c89e2467]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Flushing IO for device /dev/sdi {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[386bf44e-651e-4561-8880-eec32c6587e4]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.045s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3097da-6889-4957-950f-f5b912ef38ce]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] SCSI volumes sdi have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cfe37f9-c914-4b92-9bd1-998d9dd8f2c0]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --logout" returned: 0 in 0.101s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a78a29-0fe3-44fb-b1b2-36ba76559af2]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41, portal: 172.16.0.220,3260]
Nov 16 00:46:13 user nova-compute[75826]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41, portal: 172.16.0.220,3260] successful.
Nov 16 00:46:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bab54e8c-de99-487e-afde-31912b4a0c41 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.048s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4fb6bb-81b0-41ce-a089-84e3ed98a1cf]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.634s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] <== disconnect_volume: return (1972ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "1621d261-aa12-4e57-a74e-fe565d921320" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "1621d261-aa12-4e57-a74e-fe565d921320" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] No VIF found with MAC fa:16:3e:5c:fa:48, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG nova.objects.instance [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lazy-loading 'flavor' on Instance uuid 1621d261-aa12-4e57-a74e-fe565d921320 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "1621d261-aa12-4e57-a74e-fe565d921320" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.098s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63f2070-7288-448e-a226-1b789850e24a tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.344s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "1621d261-aa12-4e57-a74e-fe565d921320" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "1621d261-aa12-4e57-a74e-fe565d921320" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:14 user nova-compute[75826]: INFO nova.compute.manager [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Attaching volume 9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f to /dev/vdb
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.utils [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05f3537-7ba0-43cc-b827-93c5c2dd19a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc74ca8-03d2-47a9-8602-de10fb9219fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dd9686-efdd-4ccf-a7b1-d39e09a91e11]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f4270c-34e5-4925-9382-50f42c3ffc10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:46:14 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[192bc594-63bd-4b95-81fb-08c742f2beb1]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.utils [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Updating existing volume attachment record: f1eee403-fdb7-4587-bd45-69072adc8f10 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lazy-loading 'flavor' on Instance uuid eeb0e320-431c-44ad-bbb9-3eda75234ed1 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4d4f200c-b7ef-463a-afa7-1dce9dff8828 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.454s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 18.635s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e -F raw /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk" returned: 0 in 2.927s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Ensure instance console log exists: /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Start _get_guest_xml network_info=[{"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='eec1cd65ea9d5150a8f7ef8343113d85',container_format='bare',created_at=2023-11-16T00:44:08Z,direct_url=<?>,disk_format='qcow2',id=f71807b8-2b40-473b-880f-4c850d3bcec8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1545772247-shelved',owner='c770637392a544c48a72c953bfd9e7c6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T00:44:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9b72d212-4581-474b-86f8-91237b789724', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGtgqiDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '5fdf32cf-b23f-4b65-8a47-1cf913b950d9', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea', 'serial': 'dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:46:14 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:46:14 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='eec1cd65ea9d5150a8f7ef8343113d85',container_format='bare',created_at=2023-11-16T00:44:08Z,direct_url=<?>,disk_format='qcow2',id=f71807b8-2b40-473b-880f-4c850d3bcec8,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1545772247-shelved',owner='c770637392a544c48a72c953bfd9e7c6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-16T00:44:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.objects.instance [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.objects.base [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Object Instance<5fdf32cf-b23f-4b65-8a47-1cf913b950d9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGtgqiDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:14 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:14 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:14 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[121ef4bb-f7c0-45fe-87ab-2e1978e068de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:46:14 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[39454c20-a0de-4192-bf97-2b28876e5309]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea] added
Nov 16 00:46:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a66852f-09f3-46d9-adf4-edd8fab285c2]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a91bb9-6fed-4cbb-8510-55ceacc74b3d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGtgqiDr {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Acquiring lock "7c67f025-987e-435c-b1d9-7936832fe72b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FGtgqiDr" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[44920349-255e-410c-a3af-cc978d5c21d1]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FGtgqiDr'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.utils [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[23731935-ef67-4ea0-aad6-39a9d9e14f94]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbdc210-7a01-4776-9f62-d4880415e8ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e23d2ea-ffc5-43c8-83bf-5ba6cc7d4f89]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8de50f9-b71d-401f-aae4-51537ee6c619]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb1ad0e-ea64-4e57-903d-450264b385b6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd77502-94ab-44a9-8967-6b199bccfb42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:46:15 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a13099-754c-4257-8e23-c153073453f8]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.utils [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a43398-94b0-42d0-a4ff-f063261e16c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea, portal: 172.16.0.220,3260]
Nov 16 00:46:15 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea, portal: 172.16.0.220,3260] successful.
Nov 16 00:46:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7659ebc2-ee5f-4f6e-8d4b-0d8885900c47]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0798c128-c563-40ee-a639-0864d3442406]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:15 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] HCTL ('40', '-', '-', 0) found on session 26 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ffa25c-35ed-42ba-a3bd-68f7cedbc597]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Searching for a device in session 26 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:46:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGtgqiDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:46:15 user nova-compute[75826]: INFO nova.compute.manager [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Swapping volume 628626d1-3245-4dbc-983e-72c3f1f3a39b for cb84881a-32e7-4f03-bc79-315eff84a25f
Nov 16 00:46:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.426s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '26331313435613931', 'path': '/dev/sdi'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331313435613931', 'path': '/dev/sdi'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T00:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1545772247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1545772247',id=14,image_ref='f71807b8-2b40-473b-880f-4c850d3bcec8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-48608115',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c770637392a544c48a72c953bfd9e7c6',ramdisk_id='',reservation_id='r-r9359cng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849437325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849437325-project-member',shelved_at='2023-11-16T00:44:13.916038',shelved_host='user',shelved_image_id='f71807b8-2b40-473b-880f-4c850d3bcec8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a858d73834524c86a1c5c8514270761e',uuid=5fdf32cf-b23f-4b65-8a47-1cf913b950d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converting VIF {"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG nova.objects.instance [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG nova.objects.base [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Object Instance<5fdf32cf-b23f-4b65-8a47-1cf913b950d9> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:46:16 user nova-compute[75826]:   <uuid>5fdf32cf-b23f-4b65-8a47-1cf913b950d9</uuid>
Nov 16 00:46:16 user nova-compute[75826]:   <name>instance-0000000e</name>
Nov 16 00:46:16 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:46:16 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:46:16 user nova-compute[75826]:   <metadata>
Nov 16 00:46:16 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:46:16 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:46:16 user nova-compute[75826]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1545772247</nova:name>
Nov 16 00:46:16 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:46:14</nova:creationTime>
Nov 16 00:46:16 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:46:16 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:46:16 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:46:16 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:46:16 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:46:16 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:46:16 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:46:16 user nova-compute[75826]:       <nova:owner>
Nov 16 00:46:16 user nova-compute[75826]:         <nova:user uuid="a858d73834524c86a1c5c8514270761e">tempest-AttachVolumeShelveTestJSON-1849437325-project-member</nova:user>
Nov 16 00:46:16 user nova-compute[75826]:         <nova:project uuid="c770637392a544c48a72c953bfd9e7c6">tempest-AttachVolumeShelveTestJSON-1849437325</nova:project>
Nov 16 00:46:16 user nova-compute[75826]:       </nova:owner>
Nov 16 00:46:16 user nova-compute[75826]:       <nova:root type="image" uuid="f71807b8-2b40-473b-880f-4c850d3bcec8"/>
Nov 16 00:46:16 user nova-compute[75826]:       <nova:ports>
Nov 16 00:46:16 user nova-compute[75826]:         <nova:port uuid="29ee5e10-3912-41da-a701-c5034a67f421">
Nov 16 00:46:16 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 00:46:16 user nova-compute[75826]:         </nova:port>
Nov 16 00:46:16 user nova-compute[75826]:       </nova:ports>
Nov 16 00:46:16 user nova-compute[75826]:     </nova:instance>
Nov 16 00:46:16 user nova-compute[75826]:   </metadata>
Nov 16 00:46:16 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:46:16 user nova-compute[75826]:     <system>
Nov 16 00:46:16 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:46:16 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:46:16 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:46:16 user nova-compute[75826]:       <entry name="serial">5fdf32cf-b23f-4b65-8a47-1cf913b950d9</entry>
Nov 16 00:46:16 user nova-compute[75826]:       <entry name="uuid">5fdf32cf-b23f-4b65-8a47-1cf913b950d9</entry>
Nov 16 00:46:16 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:46:16 user nova-compute[75826]:     </system>
Nov 16 00:46:16 user nova-compute[75826]:   </sysinfo>
Nov 16 00:46:16 user nova-compute[75826]:   <os>
Nov 16 00:46:16 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:46:16 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:46:16 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:46:16 user nova-compute[75826]:   </os>
Nov 16 00:46:16 user nova-compute[75826]:   <features>
Nov 16 00:46:16 user nova-compute[75826]:     <acpi/>
Nov 16 00:46:16 user nova-compute[75826]:     <apic/>
Nov 16 00:46:16 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:46:16 user nova-compute[75826]:   </features>
Nov 16 00:46:16 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:46:16 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:46:16 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:46:16 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:46:16 user nova-compute[75826]:   </clock>
Nov 16 00:46:16 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:46:16 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:46:16 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:46:16 user nova-compute[75826]:   </cpu>
Nov 16 00:46:16 user nova-compute[75826]:   <devices>
Nov 16 00:46:16 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:46:16 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:46:16 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk"/>
Nov 16 00:46:16 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:46:16 user nova-compute[75826]:     </disk>
Nov 16 00:46:16 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:46:16 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:46:16 user nova-compute[75826]:       <source dev="/dev/sdi"/>
Nov 16 00:46:16 user nova-compute[75826]:       <target dev="vdc" bus="virtio"/>
Nov 16 00:46:16 user nova-compute[75826]:       <serial>dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea</serial>
Nov 16 00:46:16 user nova-compute[75826]:     </disk>
Nov 16 00:46:16 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:46:16 user nova-compute[75826]:       <mac address="fa:16:3e:44:bf:4c"/>
Nov 16 00:46:16 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:46:16 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:46:16 user nova-compute[75826]:       <target dev="tap29ee5e10-39"/>
Nov 16 00:46:16 user nova-compute[75826]:     </interface>
Nov 16 00:46:16 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:46:16 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/console.log" append="off"/>
Nov 16 00:46:16 user nova-compute[75826]:     </serial>
Nov 16 00:46:16 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:46:16 user nova-compute[75826]:     <video>
Nov 16 00:46:16 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:46:16 user nova-compute[75826]:     </video>
Nov 16 00:46:16 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:46:16 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:46:16 user nova-compute[75826]:     </rng>
Nov 16 00:46:16 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:46:16 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:46:16 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:46:16 user nova-compute[75826]:     </memballoon>
Nov 16 00:46:16 user nova-compute[75826]:   </devices>
Nov 16 00:46:16 user nova-compute[75826]: </domain>
Nov 16 00:46:16 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T00:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1545772247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1545772247',id=14,image_ref='f71807b8-2b40-473b-880f-4c850d3bcec8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-48608115',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:42:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c770637392a544c48a72c953bfd9e7c6',ramdisk_id='',reservation_id='r-r9359cng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849437325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849437325-project-member',shelved_at='2023-11-16T00:44:13.916038',shelved_host='user',shelved_image_id='f71807b8-2b40-473b-880f-4c850d3bcec8'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:46:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a858d73834524c86a1c5c8514270761e',uuid=5fdf32cf-b23f-4b65-8a47-1cf913b950d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converting VIF {"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG os_vif [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38c06e10-1a65-5ee0-9f1d-3d52e1d809ff', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29ee5e10-39, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29ee5e10-39, col_values=(('qos', UUID('46b096bc-e954-483f-b5bc-536fe7fd215d')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29ee5e10-39, col_values=(('external_ids', {'iface-id': '29ee5e10-3912-41da-a701-c5034a67f421', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:bf:4c', 'vm-uuid': '5fdf32cf-b23f-4b65-8a47-1cf913b950d9'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:16 user nova-compute[75826]: INFO os_vif [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39')
Nov 16 00:46:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:46:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] No VIF found with MAC fa:16:3e:44:bf:4c, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:46:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:18 user nova-compute[75826]: DEBUG nova.compute.manager [req-7ea97ac3-2614-4a49-80c9-ea144e48e3eb req-458e3984-0e83-40c0-acba-7e8c54074111 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7ea97ac3-2614-4a49-80c9-ea144e48e3eb req-458e3984-0e83-40c0-acba-7e8c54074111 service nova] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7ea97ac3-2614-4a49-80c9-ea144e48e3eb req-458e3984-0e83-40c0-acba-7e8c54074111 service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7ea97ac3-2614-4a49-80c9-ea144e48e3eb req-458e3984-0e83-40c0-acba-7e8c54074111 service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:18 user nova-compute[75826]: DEBUG nova.compute.manager [req-7ea97ac3-2614-4a49-80c9-ea144e48e3eb req-458e3984-0e83-40c0-acba-7e8c54074111 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] No waiting events found dispatching network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:18 user nova-compute[75826]: WARNING nova.compute.manager [req-7ea97ac3-2614-4a49-80c9-ea144e48e3eb req-458e3984-0e83-40c0-acba-7e8c54074111 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received unexpected event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 00:46:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:46:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:19 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:46:19 user nova-compute[75826]: INFO nova.compute.claims [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Claim successful on node user
Nov 16 00:46:19 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:46:19 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:46:20 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:46:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG nova.policy [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e2d1a7cea414446842b5abfc9fe93de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ad3ee3a8e04d728243e886a1460cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:46:20 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Instance spawned successfully.
Nov 16 00:46:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:46:20 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Creating image(s)
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "/opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "/opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fd02395f-1d93-4ed3-82b3-8aa060f27501 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.831s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk 1073741824" returned: 0 in 0.063s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG nova.compute.manager [req-7d79c6df-2678-4b48-b037-ee5f1d65d92f req-aed7b98b-84ee-42ba-9174-09c022f3fc87 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7d79c6df-2678-4b48-b037-ee5f1d65d92f req-aed7b98b-84ee-42ba-9174-09c022f3fc87 service nova] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7d79c6df-2678-4b48-b037-ee5f1d65d92f req-aed7b98b-84ee-42ba-9174-09c022f3fc87 service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7d79c6df-2678-4b48-b037-ee5f1d65d92f req-aed7b98b-84ee-42ba-9174-09c022f3fc87 service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG nova.compute.manager [req-7d79c6df-2678-4b48-b037-ee5f1d65d92f req-aed7b98b-84ee-42ba-9174-09c022f3fc87 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] No waiting events found dispatching network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:20 user nova-compute[75826]: WARNING nova.compute.manager [req-7d79c6df-2678-4b48-b037-ee5f1d65d92f req-aed7b98b-84ee-42ba-9174-09c022f3fc87 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received unexpected event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 for instance with vm_state active and task_state None.
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:46:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:21 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Cannot resize image /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:46:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:46:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Ensure instance console log exists: /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:46:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:21 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Successfully created port: 20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:46:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Successfully updated port: 20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "refresh_cache-b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquired lock "refresh_cache-b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Updating instance_info_cache with network_info: [{"id": "20542643-dc4b-4716-bf96-31e9bbd727e1", "address": "fa:16:3e:98:06:9c", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20542643-dc", "ovs_interfaceid": "20542643-dc4b-4716-bf96-31e9bbd727e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Releasing lock "refresh_cache-b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Instance network_info: |[{"id": "20542643-dc4b-4716-bf96-31e9bbd727e1", "address": "fa:16:3e:98:06:9c", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20542643-dc", "ovs_interfaceid": "20542643-dc4b-4716-bf96-31e9bbd727e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Start _get_guest_xml network_info=[{"id": "20542643-dc4b-4716-bf96-31e9bbd727e1", "address": "fa:16:3e:98:06:9c", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20542643-dc", "ovs_interfaceid": "20542643-dc4b-4716-bf96-31e9bbd727e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:46:22 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:46:22 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-76035410',display_name='tempest-AttachVolumeNegativeTest-server-76035410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-76035410',id=23,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnLU67ji+IH97B3T2sH00GLwc0CK8bTpeZKm7tnoqbCn+8nMjfkOIuzXpH7GqA4zMxY28R7GzpgDvnFFEiI6XjbOv8468tyX7sqMsN+0k0nr1MfahNO8Pi78kkijWYoHw==',key_name='tempest-keypair-925187123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ad3ee3a8e04d728243e886a1460cae',ramdisk_id='',reservation_id='r-wjlms705',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471555798',owner_user_name='tempest-AttachVolumeNegativeTest-471555798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e2d1a7cea414446842b5abfc9fe93de',uuid=b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20542643-dc4b-4716-bf96-31e9bbd727e1", "address": "fa:16:3e:98:06:9c", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20542643-dc", "ovs_interfaceid": "20542643-dc4b-4716-bf96-31e9bbd727e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converting VIF {"id": "20542643-dc4b-4716-bf96-31e9bbd727e1", "address": "fa:16:3e:98:06:9c", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20542643-dc", "ovs_interfaceid": "20542643-dc4b-4716-bf96-31e9bbd727e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:06:9c,bridge_name='br-int',has_traffic_filtering=True,id=20542643-dc4b-4716-bf96-31e9bbd727e1,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20542643-dc') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.objects.instance [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'pci_devices' on Instance uuid b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:46:22 user nova-compute[75826]:   <uuid>b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8</uuid>
Nov 16 00:46:22 user nova-compute[75826]:   <name>instance-00000017</name>
Nov 16 00:46:22 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:46:22 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:46:22 user nova-compute[75826]:   <metadata>
Nov 16 00:46:22 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:46:22 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:46:22 user nova-compute[75826]:       <nova:name>tempest-AttachVolumeNegativeTest-server-76035410</nova:name>
Nov 16 00:46:22 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:46:22</nova:creationTime>
Nov 16 00:46:22 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:46:22 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:46:22 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:46:22 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:46:22 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:46:22 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:46:22 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:46:22 user nova-compute[75826]:       <nova:owner>
Nov 16 00:46:22 user nova-compute[75826]:         <nova:user uuid="0e2d1a7cea414446842b5abfc9fe93de">tempest-AttachVolumeNegativeTest-471555798-project-member</nova:user>
Nov 16 00:46:22 user nova-compute[75826]:         <nova:project uuid="13ad3ee3a8e04d728243e886a1460cae">tempest-AttachVolumeNegativeTest-471555798</nova:project>
Nov 16 00:46:22 user nova-compute[75826]:       </nova:owner>
Nov 16 00:46:22 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:46:22 user nova-compute[75826]:       <nova:ports>
Nov 16 00:46:22 user nova-compute[75826]:         <nova:port uuid="20542643-dc4b-4716-bf96-31e9bbd727e1">
Nov 16 00:46:22 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 00:46:22 user nova-compute[75826]:         </nova:port>
Nov 16 00:46:22 user nova-compute[75826]:       </nova:ports>
Nov 16 00:46:22 user nova-compute[75826]:     </nova:instance>
Nov 16 00:46:22 user nova-compute[75826]:   </metadata>
Nov 16 00:46:22 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:46:22 user nova-compute[75826]:     <system>
Nov 16 00:46:22 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:46:22 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:46:22 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:46:22 user nova-compute[75826]:       <entry name="serial">b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8</entry>
Nov 16 00:46:22 user nova-compute[75826]:       <entry name="uuid">b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8</entry>
Nov 16 00:46:22 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:46:22 user nova-compute[75826]:     </system>
Nov 16 00:46:22 user nova-compute[75826]:   </sysinfo>
Nov 16 00:46:22 user nova-compute[75826]:   <os>
Nov 16 00:46:22 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:46:22 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:46:22 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:46:22 user nova-compute[75826]:   </os>
Nov 16 00:46:22 user nova-compute[75826]:   <features>
Nov 16 00:46:22 user nova-compute[75826]:     <acpi/>
Nov 16 00:46:22 user nova-compute[75826]:     <apic/>
Nov 16 00:46:22 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:46:22 user nova-compute[75826]:   </features>
Nov 16 00:46:22 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:46:22 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:46:22 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:46:22 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:46:22 user nova-compute[75826]:   </clock>
Nov 16 00:46:22 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:46:22 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:46:22 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:46:22 user nova-compute[75826]:   </cpu>
Nov 16 00:46:22 user nova-compute[75826]:   <devices>
Nov 16 00:46:22 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:46:22 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:46:22 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk"/>
Nov 16 00:46:22 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:46:22 user nova-compute[75826]:     </disk>
Nov 16 00:46:22 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:46:22 user nova-compute[75826]:       <mac address="fa:16:3e:98:06:9c"/>
Nov 16 00:46:22 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:46:22 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:46:22 user nova-compute[75826]:       <target dev="tap20542643-dc"/>
Nov 16 00:46:22 user nova-compute[75826]:     </interface>
Nov 16 00:46:22 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:46:22 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/console.log" append="off"/>
Nov 16 00:46:22 user nova-compute[75826]:     </serial>
Nov 16 00:46:22 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:46:22 user nova-compute[75826]:     <video>
Nov 16 00:46:22 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:46:22 user nova-compute[75826]:     </video>
Nov 16 00:46:22 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:46:22 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:46:22 user nova-compute[75826]:     </rng>
Nov 16 00:46:22 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:46:22 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:46:22 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:46:22 user nova-compute[75826]:     </memballoon>
Nov 16 00:46:22 user nova-compute[75826]:   </devices>
Nov 16 00:46:22 user nova-compute[75826]: </domain>
Nov 16 00:46:22 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-76035410',display_name='tempest-AttachVolumeNegativeTest-server-76035410',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-76035410',id=23,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnLU67ji+IH97B3T2sH00GLwc0CK8bTpeZKm7tnoqbCn+8nMjfkOIuzXpH7GqA4zMxY28R7GzpgDvnFFEiI6XjbOv8468tyX7sqMsN+0k0nr1MfahNO8Pi78kkijWYoHw==',key_name='tempest-keypair-925187123',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ad3ee3a8e04d728243e886a1460cae',ramdisk_id='',reservation_id='r-wjlms705',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471555798',owner_user_name='tempest-AttachVolumeNegativeTest-471555798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:46:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e2d1a7cea414446842b5abfc9fe93de',uuid=b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20542643-dc4b-4716-bf96-31e9bbd727e1", "address": "fa:16:3e:98:06:9c", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20542643-dc", "ovs_interfaceid": "20542643-dc4b-4716-bf96-31e9bbd727e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converting VIF {"id": "20542643-dc4b-4716-bf96-31e9bbd727e1", "address": "fa:16:3e:98:06:9c", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20542643-dc", "ovs_interfaceid": "20542643-dc4b-4716-bf96-31e9bbd727e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:06:9c,bridge_name='br-int',has_traffic_filtering=True,id=20542643-dc4b-4716-bf96-31e9bbd727e1,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20542643-dc') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG os_vif [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:06:9c,bridge_name='br-int',has_traffic_filtering=True,id=20542643-dc4b-4716-bf96-31e9bbd727e1,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20542643-dc') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd7e8f92a-c8e8-56e0-b937-a52c4db6675d', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20542643-dc, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap20542643-dc, col_values=(('qos', UUID('04a7730f-fafe-4616-8e2a-273dbae3610d')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap20542643-dc, col_values=(('external_ids', {'iface-id': '20542643-dc4b-4716-bf96-31e9bbd727e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:06:9c', 'vm-uuid': 'b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:22 user nova-compute[75826]: INFO os_vif [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:06:9c,bridge_name='br-int',has_traffic_filtering=True,id=20542643-dc4b-4716-bf96-31e9bbd727e1,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20542643-dc')
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No VIF found with MAC fa:16:3e:98:06:9c, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-7129c052-3476-4cfd-b4f5-bbf09ea54d92 req-64e869c6-047c-465e-9861-b2774c5878b2 service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Received event network-changed-20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-7129c052-3476-4cfd-b4f5-bbf09ea54d92 req-64e869c6-047c-465e-9861-b2774c5878b2 service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Refreshing instance network info cache due to event network-changed-20542643-dc4b-4716-bf96-31e9bbd727e1. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7129c052-3476-4cfd-b4f5-bbf09ea54d92 req-64e869c6-047c-465e-9861-b2774c5878b2 service nova] Acquiring lock "refresh_cache-b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7129c052-3476-4cfd-b4f5-bbf09ea54d92 req-64e869c6-047c-465e-9861-b2774c5878b2 service nova] Acquired lock "refresh_cache-b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:46:22 user nova-compute[75826]: DEBUG nova.network.neutron [req-7129c052-3476-4cfd-b4f5-bbf09ea54d92 req-64e869c6-047c-465e-9861-b2774c5878b2 service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Refreshing network info cache for port 20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXwoKVSP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:23 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:23 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:23 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd07976-cffa-4a94-b161-7853490ed2f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:46:23 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG nova.network.neutron [req-7129c052-3476-4cfd-b4f5-bbf09ea54d92 req-64e869c6-047c-465e-9861-b2774c5878b2 service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Updated VIF entry in instance network info cache for port 20542643-dc4b-4716-bf96-31e9bbd727e1. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG nova.network.neutron [req-7129c052-3476-4cfd-b4f5-bbf09ea54d92 req-64e869c6-047c-465e-9861-b2774c5878b2 service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Updating instance_info_cache with network_info: [{"id": "20542643-dc4b-4716-bf96-31e9bbd727e1", "address": "fa:16:3e:98:06:9c", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20542643-dc", "ovs_interfaceid": "20542643-dc4b-4716-bf96-31e9bbd727e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8f7037-b11b-4ffc-a375-af6ffb551ede]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f] added
Nov 16 00:46:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7129c052-3476-4cfd-b4f5-bbf09ea54d92 req-64e869c6-047c-465e-9861-b2774c5878b2 service nova] Releasing lock "refresh_cache-b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[093b64a4-fb24-4a40-91bd-5de8752e4437]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ae8c7f-e066-4e73-956a-0b1083bbdc59]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXwoKVSP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uXwoKVSP" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfb3549-886b-4800-bce8-0155c7e4835a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uXwoKVSP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4173505-302e-4a98-a348-2db132feca0c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f720b310-4dd0-4445-add0-512d5b2ba76c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --login" returned: 0 in 0.108s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8412578c-d274-41e9-87b9-bfe1ce89137e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f, portal: 172.16.0.220,3260]
Nov 16 00:46:23 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f, portal: 172.16.0.220,3260] successful.
Nov 16 00:46:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a7748b-db80-41da-b2a2-1f7e2223ef65]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f339f80-91a4-46e2-aa99-d7320a771c48]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:23 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] HCTL ('42', '-', '-', 0) found on session 27 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Scanning host 42 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host42/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host42/scan" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab8f100-ae3e-4d01-ac07-579849d08818]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Searching for a device in session 27 and hctl ['42', '*', '*', 0] yield: sdk {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Connected to sdk using {'target_iqn': 'iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXwoKVSP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.437s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23466373033636435', 'path': '/dev/sdk'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466373033636435', 'path': '/dev/sdk'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG nova.objects.instance [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lazy-loading 'flavor' on Instance uuid 1621d261-aa12-4e57-a74e-fe565d921320 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:46:24 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:46:24 user nova-compute[75826]:   <source dev="/dev/sdk"/>
Nov 16 00:46:24 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:46:24 user nova-compute[75826]:   <serial>9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f</serial>
Nov 16 00:46:24 user nova-compute[75826]: </disk>
Nov 16 00:46:24 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-39d9dd65-6e6c-4d3d-bb53-efdf2f80ea2a req-856b3a78-ae62-4347-b1f6-26c03d67e70a service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Received event network-vif-plugged-20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-39d9dd65-6e6c-4d3d-bb53-efdf2f80ea2a req-856b3a78-ae62-4347-b1f6-26c03d67e70a service nova] Acquiring lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-39d9dd65-6e6c-4d3d-bb53-efdf2f80ea2a req-856b3a78-ae62-4347-b1f6-26c03d67e70a service nova] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-39d9dd65-6e6c-4d3d-bb53-efdf2f80ea2a req-856b3a78-ae62-4347-b1f6-26c03d67e70a service nova] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-39d9dd65-6e6c-4d3d-bb53-efdf2f80ea2a req-856b3a78-ae62-4347-b1f6-26c03d67e70a service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] No waiting events found dispatching network-vif-plugged-20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:24 user nova-compute[75826]: WARNING nova.compute.manager [req-39d9dd65-6e6c-4d3d-bb53-efdf2f80ea2a req-856b3a78-ae62-4347-b1f6-26c03d67e70a service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Received unexpected event network-vif-plugged-20542643-dc4b-4716-bf96-31e9bbd727e1 for instance with vm_state building and task_state spawning.
Nov 16 00:46:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-39d9dd65-6e6c-4d3d-bb53-efdf2f80ea2a req-856b3a78-ae62-4347-b1f6-26c03d67e70a service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Received event network-vif-plugged-20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-39d9dd65-6e6c-4d3d-bb53-efdf2f80ea2a req-856b3a78-ae62-4347-b1f6-26c03d67e70a service nova] Acquiring lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-39d9dd65-6e6c-4d3d-bb53-efdf2f80ea2a req-856b3a78-ae62-4347-b1f6-26c03d67e70a service nova] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-39d9dd65-6e6c-4d3d-bb53-efdf2f80ea2a req-856b3a78-ae62-4347-b1f6-26c03d67e70a service nova] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-39d9dd65-6e6c-4d3d-bb53-efdf2f80ea2a req-856b3a78-ae62-4347-b1f6-26c03d67e70a service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] No waiting events found dispatching network-vif-plugged-20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:24 user nova-compute[75826]: WARNING nova.compute.manager [req-39d9dd65-6e6c-4d3d-bb53-efdf2f80ea2a req-856b3a78-ae62-4347-b1f6-26c03d67e70a service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Received unexpected event network-vif-plugged-20542643-dc4b-4716-bf96-31e9bbd727e1 for instance with vm_state building and task_state spawning.
Nov 16 00:46:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:46:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:46:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] No VIF found with MAC fa:16:3e:5f:1e:f8, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:46:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-85a36a08-228a-44b6-abbb-464ebb1159fa tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "1621d261-aa12-4e57-a74e-fe565d921320" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.038s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aeZEyIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c67f025-987e-435c-b1d9-7936832fe72b', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb84881a-32e7-4f03-bc79-315eff84a25f', 'serial': 'cb84881a-32e7-4f03-bc79-315eff84a25f'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBykUMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '7c67f025-987e-435c-b1d9-7936832fe72b', 'attached_at': '', 'detached_at': '', 'volume_id': '628626d1-3245-4dbc-983e-72c3f1f3a39b', 'serial'} {{(pid=75826) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aeZEyIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:26 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:26 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:26 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa0b407-7fb4-4425-aa9a-f994d61b4b12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:46:26 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f5837e6-fc6c-49b9-b016-f86b8afc5e72]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f] added
Nov 16 00:46:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde5ad65-8a48-42a1-913c-dc215b68d985]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ecbcab-1509-4a21-801a-3944567434ec]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aeZEyIYH {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aeZEyIYH" returned: 0 in 0.049s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0b23f3-9ace-44f4-8af7-86ae97123e6f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aeZEyIYH'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dd185e-3e23-44b7-bef5-52e0a6c68ebf]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a54ed4b-fcd9-450b-8ccd-1fe418cafa22]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:46:26 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Instance spawned successfully.
Nov 16 00:46:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --login" returned: 0 in 0.103s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce25e79-0583-48bc-ab60-d57f1e30cd06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f, portal: 172.16.0.220,3260]
Nov 16 00:46:26 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f, portal: 172.16.0.220,3260] successful.
Nov 16 00:46:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e459d52d-6dea-4a9d-82fb-8c13292e9ad1]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:26 user nova-compute[75826]: INFO nova.compute.manager [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Took 6.21 seconds to spawn the instance on the hypervisor.
Nov 16 00:46:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[63159b2e-365e-4f71-b4a6-2bf21fec9750]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:26 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] HCTL ('43', '-', '-', 0) found on session 28 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Scanning host 43 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host43/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host43/scan" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f119a128-4744-4992-8fb2-a651850158a3]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Searching for a device in session 28 and hctl ['43', '*', '*', 0] yield: sdl {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:46:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Connected to sdl using {'target_iqn': 'iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aeZEyIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:46:26 user nova-compute[75826]: INFO nova.compute.manager [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Took 7.10 seconds to build instance.
Nov 16 00:46:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a4de8e32-b412-4010-92bb-c566b1d97ce1 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.231s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "1621d261-aa12-4e57-a74e-fe565d921320" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "1621d261-aa12-4e57-a74e-fe565d921320" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:27 user nova-compute[75826]: INFO nova.compute.manager [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Detaching volume 9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f
Nov 16 00:46:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:27 user nova-compute[75826]: INFO nova.virt.block_device [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Attempting to driver detach volume 9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f from mountpoint /dev/vdb
Nov 16 00:46:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Attempting to detach device vdb from instance 1621d261-aa12-4e57-a74e-fe565d921320 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:46:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:46:27 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:46:27 user nova-compute[75826]:   <source dev="/dev/sdk"/>
Nov 16 00:46:27 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:46:27 user nova-compute[75826]:   <serial>9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f</serial>
Nov 16 00:46:27 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:46:27 user nova-compute[75826]: </disk>
Nov 16 00:46:27 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:46:27 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Successfully detached device vdb from instance 1621d261-aa12-4e57-a74e-fe565d921320 from the persistent domain config.
Nov 16 00:46:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1621d261-aa12-4e57-a74e-fe565d921320 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:46:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:46:27 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:46:27 user nova-compute[75826]:   <source dev="/dev/sdk"/>
Nov 16 00:46:27 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:46:27 user nova-compute[75826]:   <serial>9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f</serial>
Nov 16 00:46:27 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:46:27 user nova-compute[75826]: </disk>
Nov 16 00:46:27 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:46:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.445s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23963633839633764', 'path': '/dev/sdl'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23963633839633764', 'path': '/dev/sdl'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:46:27 user nova-compute[75826]: DEBUG nova.objects.instance [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lazy-loading 'flavor' on Instance uuid 7c67f025-987e-435c-b1d9-7936832fe72b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1621d261-aa12-4e57-a74e-fe565d921320 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:46:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 93323264 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 211812352 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 352321536 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 446693376 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 603979776 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 721420288 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-66969fd6-afef-42d6-b424-f6986c2c8f8a req-dc365850-d449-4b92-988c-9de632ab8fe4 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-changed-950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-66969fd6-afef-42d6-b424-f6986c2c8f8a req-dc365850-d449-4b92-988c-9de632ab8fe4 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing instance network info cache due to event network-changed-950ac11c-60e7-4772-ab1f-51235827d355. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:46:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66969fd6-afef-42d6-b424-f6986c2c8f8a req-dc365850-d449-4b92-988c-9de632ab8fe4 service nova] Acquiring lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:46:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66969fd6-afef-42d6-b424-f6986c2c8f8a req-dc365850-d449-4b92-988c-9de632ab8fe4 service nova] Acquired lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:46:31 user nova-compute[75826]: DEBUG nova.network.neutron [req-66969fd6-afef-42d6-b424-f6986c2c8f8a req-dc365850-d449-4b92-988c-9de632ab8fe4 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Refreshing network info cache for port 950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:46:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 866123776 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:31 user nova-compute[75826]: DEBUG nova.network.neutron [req-66969fd6-afef-42d6-b424-f6986c2c8f8a req-dc365850-d449-4b92-988c-9de632ab8fe4 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updated VIF entry in instance network info cache for port 950ac11c-60e7-4772-ab1f-51235827d355. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:46:31 user nova-compute[75826]: DEBUG nova.network.neutron [req-66969fd6-afef-42d6-b424-f6986c2c8f8a req-dc365850-d449-4b92-988c-9de632ab8fe4 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating instance_info_cache with network_info: [{"id": "950ac11c-60e7-4772-ab1f-51235827d355", "address": "fa:16:3e:9c:63:6f", "network": {"id": "72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-711726094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950ac11c-60", "ovs_interfaceid": "950ac11c-60e7-4772-ab1f-51235827d355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "3753c6de-ba1a-4839-81db-e9920a6b815f", "address": "fa:16:3e:c1:93:99", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753c6de-ba", "ovs_interfaceid": "3753c6de-ba1a-4839-81db-e9920a6b815f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66969fd6-afef-42d6-b424-f6986c2c8f8a req-dc365850-d449-4b92-988c-9de632ab8fe4 service nova] Releasing lock "refresh_cache-535e7401-0fb4-4e12-9110-515c63fd32c0" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 1018167296 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBykUMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:32 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:32 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[af27067d-b7d7-4742-981c-93044962dcc4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:46:32 user nova-compute[75826]: No targets found.
Nov 16 00:46:32 user nova-compute[75826]: iSNS:
Nov 16 00:46:32 user nova-compute[75826]: No targets found.
Nov 16 00:46:32 user nova-compute[75826]: STATIC:
Nov 16 00:46:32 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:46:32 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:32 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:32 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a
Nov 16 00:46:32 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:32 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:32 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:46:32 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:32 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:32 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3
Nov 16 00:46:32 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:32 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:32 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:46:32 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:32 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:32 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b
Nov 16 00:46:32 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:32 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:32 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f
Nov 16 00:46:32 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:32 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:32 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:46:32 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:32 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:32 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:46:32 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:32 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:32 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f
Nov 16 00:46:32 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:32 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:32 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a
Nov 16 00:46:32 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:32 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:32 user nova-compute[75826]: FIRMWARE:
Nov 16 00:46:32 user nova-compute[75826]: No targets found.
Nov 16 00:46:32 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:46:32 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:46:32 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c6bff9-64d8-49b0-b23b-849239d826fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f963ef25-c08c-45b0-995f-5bef4e3064b0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:32 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:32 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:32 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdbc0c9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b'): ({'sdj'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Removing single pathed devices sdj {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.116s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aebad5-d075-4fb4-bfad-93f221bfa8bb]: (4, ('path checker states:\nup                  11\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb5adaa-9a13-4dfa-94a4-0f757614fbee]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Flushing IO for device /dev/sdj {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f650475-570b-4f86-80d9-5a3fe4da5430]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:46:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.035s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3629a40-1798-4798-8965-fa5dbb590fbe]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Checking to see if SCSI volumes sdj have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] SCSI volumes sdj have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b4dc82f-1ad3-4576-8ea2-705e752baefc]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75dc517-e3a6-4e21-93ef-86b0149c45f3]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260]
Nov 16 00:46:33 user nova-compute[75826]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260] successful.
Nov 16 00:46:33 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afd94c2-6acb-4e37-b1d0-20f7a3b5e330]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.472s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] <== disconnect_volume: return (473ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG nova.compute.manager [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aeZEyIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl'}, 'status': 'reserved', 'instance': '7c67f025-987e-435c-b1d9-7936832fe72b', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb84881a-32e7-4f03-bc79-315eff84a25f', 'serial'} {{(pid=75826) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG nova.compute.manager [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] swap_volume: removing Cinder connection for volume 628626d1-3245-4dbc-983e-72c3f1f3a39b {{(pid=75826) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:33 user nova-compute[75826]: INFO nova.compute.manager [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Terminating instance
Nov 16 00:46:33 user nova-compute[75826]: DEBUG nova.compute.manager [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] swap_volume: Updating volume 628626d1-3245-4dbc-983e-72c3f1f3a39b BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "aeZEyIYH", "auth_password": "3CfXmLcva1B9Zr", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdl", "volume_id": "cb84881a-32e7-4f03-bc79-315eff84a25f"}, "status": "reserved", "instance": "7c67f025-987e-435c-b1d9-7936832fe72b", "attached_at": "", "detached_at": "", "volume_id": "cb84881a-32e7-4f03-bc79-315eff84a25f", "serial": "cb84881a-32e7-4f03-bc79-315eff84a25f"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'cb84881a-32e7-4f03-bc79-315eff84a25f', 'no_device': None, 'attachment_id': '4a60001d-e255-4a24-8a31-2778c23249a6'} {{(pid=75826) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0316403f-bc9e-46c4-9259-d0f375c3bdd4 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 19.146s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-8a157a62-4b3b-40f9-abe2-b707b7c86138 req-dc396e24-9eb6-4862-aa41-3bf1a480395a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8a157a62-4b3b-40f9-abe2-b707b7c86138 req-dc396e24-9eb6-4862-aa41-3bf1a480395a service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8a157a62-4b3b-40f9-abe2-b707b7c86138 req-dc396e24-9eb6-4862-aa41-3bf1a480395a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8a157a62-4b3b-40f9-abe2-b707b7c86138 req-dc396e24-9eb6-4862-aa41-3bf1a480395a service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-8a157a62-4b3b-40f9-abe2-b707b7c86138 req-dc396e24-9eb6-4862-aa41-3bf1a480395a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-unplugged-950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-8a157a62-4b3b-40f9-abe2-b707b7c86138 req-dc396e24-9eb6-4862-aa41-3bf1a480395a service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-950ac11c-60e7-4772-ab1f-51235827d355 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-e494185b-034e-4951-9268-4fdc644ef64b req-41ddd5a0-809f-4ac9-b68c-9e359b134040 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-44813b22-4904-4534-9674-14220b2ee743 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e494185b-034e-4951-9268-4fdc644ef64b req-41ddd5a0-809f-4ac9-b68c-9e359b134040 service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e494185b-034e-4951-9268-4fdc644ef64b req-41ddd5a0-809f-4ac9-b68c-9e359b134040 service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e494185b-034e-4951-9268-4fdc644ef64b req-41ddd5a0-809f-4ac9-b68c-9e359b134040 service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-e494185b-034e-4951-9268-4fdc644ef64b req-41ddd5a0-809f-4ac9-b68c-9e359b134040 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-unplugged-44813b22-4904-4534-9674-14220b2ee743 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-e494185b-034e-4951-9268-4fdc644ef64b req-41ddd5a0-809f-4ac9-b68c-9e359b134040 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-44813b22-4904-4534-9674-14220b2ee743 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-9b76f4f7-5d79-440e-9493-a8c585395325 req-45920302-6200-44d5-a1fd-8e501bc2fbaf service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-5f1e8fd9-8c1e-4815-9320-fe039c91101f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9b76f4f7-5d79-440e-9493-a8c585395325 req-45920302-6200-44d5-a1fd-8e501bc2fbaf service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9b76f4f7-5d79-440e-9493-a8c585395325 req-45920302-6200-44d5-a1fd-8e501bc2fbaf service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9b76f4f7-5d79-440e-9493-a8c585395325 req-45920302-6200-44d5-a1fd-8e501bc2fbaf service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-9b76f4f7-5d79-440e-9493-a8c585395325 req-45920302-6200-44d5-a1fd-8e501bc2fbaf service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-unplugged-5f1e8fd9-8c1e-4815-9320-fe039c91101f {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-9b76f4f7-5d79-440e-9493-a8c585395325 req-45920302-6200-44d5-a1fd-8e501bc2fbaf service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-5f1e8fd9-8c1e-4815-9320-fe039c91101f for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Acquiring lock "7c67f025-987e-435c-b1d9-7936832fe72b" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG os_brick.utils [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7040902e-1344-4f23-944e-39f2a45ef33d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.038s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99685dd-cbd1-47b3-9b14-7d7b38971721]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6387c5a7-8b8a-4044-bfcd-393cb299e5fc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cc87ca-ba4a-4eb1-8436-4b0d36cb94f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:46:35 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:46:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[952ea508-c446-4d75-97a8-9e68cc2ef5af]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG os_brick.utils [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:35 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Instance destroyed successfully.
Nov 16 00:46:35 user nova-compute[75826]: DEBUG nova.objects.instance [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lazy-loading 'resources' on Instance uuid 535e7401-0fb4-4e12-9110-515c63fd32c0 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "950ac11c-60e7-4772-ab1f-51235827d355", "address": "fa:16:3e:9c:63:6f", "network": {"id": "72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-711726094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950ac11c-60", "ovs_interfaceid": "950ac11c-60e7-4772-ab1f-51235827d355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "950ac11c-60e7-4772-ab1f-51235827d355", "address": "fa:16:3e:9c:63:6f", "network": {"id": "72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-711726094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950ac11c-60", "ovs_interfaceid": "950ac11c-60e7-4772-ab1f-51235827d355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:63:6f,bridge_name='br-int',has_traffic_filtering=True,id=950ac11c-60e7-4772-ab1f-51235827d355,network=Network(72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950ac11c-60') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:63:6f,bridge_name='br-int',has_traffic_filtering=True,id=950ac11c-60e7-4772-ab1f-51235827d355,network=Network(72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950ac11c-60') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap950ac11c-60, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:35 user nova-compute[75826]: INFO nova.compute.manager [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Swapping volume cb84881a-32e7-4f03-bc79-315eff84a25f for 628626d1-3245-4dbc-983e-72c3f1f3a39b
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e740eeed-5a80-4a36-9c39-73c388da7a5d) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: INFO os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:63:6f,bridge_name='br-int',has_traffic_filtering=True,id=950ac11c-60e7-4772-ab1f-51235827d355,network=Network(72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950ac11c-60')
Nov 16 00:46:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:39:58,bridge_name='br-int',has_traffic_filtering=True,id=44813b22-4904-4534-9674-14220b2ee743,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44813b22-49') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:39:58,bridge_name='br-int',has_traffic_filtering=True,id=44813b22-4904-4534-9674-14220b2ee743,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44813b22-49') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44813b22-49, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6ce7a5e-874f-4138-8c0d-c06a005a87ea) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: INFO os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:39:58,bridge_name='br-int',has_traffic_filtering=True,id=44813b22-4904-4534-9674-14220b2ee743,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44813b22-49')
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:cc,bridge_name='br-int',has_traffic_filtering=True,id=09a45f64-c713-4faf-b030-9a71edc2bfe5,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09a45f64-c7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:cc,bridge_name='br-int',has_traffic_filtering=True,id=09a45f64-c713-4faf-b030-9a71edc2bfe5,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09a45f64-c7') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap09a45f64-c7, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8428c39c-417a-4a55-9522-a2eac3171c95) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: INFO os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:e2:cc,bridge_name='br-int',has_traffic_filtering=True,id=09a45f64-c713-4faf-b030-9a71edc2bfe5,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap09a45f64-c7')
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3753c6de-ba1a-4839-81db-e9920a6b815f", "address": "fa:16:3e:c1:93:99", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753c6de-ba", "ovs_interfaceid": "3753c6de-ba1a-4839-81db-e9920a6b815f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "3753c6de-ba1a-4839-81db-e9920a6b815f", "address": "fa:16:3e:c1:93:99", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.19", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3753c6de-ba", "ovs_interfaceid": "3753c6de-ba1a-4839-81db-e9920a6b815f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:93:99,bridge_name='br-int',has_traffic_filtering=True,id=3753c6de-ba1a-4839-81db-e9920a6b815f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753c6de-ba') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:93:99,bridge_name='br-int',has_traffic_filtering=True,id=3753c6de-ba1a-4839-81db-e9920a6b815f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753c6de-ba') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3753c6de-ba, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=acbf2c67-6dc4-4b1a-9052-e6bca37f23ce) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: INFO os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:93:99,bridge_name='br-int',has_traffic_filtering=True,id=3753c6de-ba1a-4839-81db-e9920a6b815f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3753c6de-ba')
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:47,bridge_name='br-int',has_traffic_filtering=True,id=5f1e8fd9-8c1e-4815-9320-fe039c91101f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1e8fd9-8c') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:47,bridge_name='br-int',has_traffic_filtering=True,id=5f1e8fd9-8c1e-4815-9320-fe039c91101f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1e8fd9-8c') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5f1e8fd9-8c, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5dff67ef-dba5-483e-9cf1-1b7fe89c2b44) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: INFO os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:8d:47,bridge_name='br-int',has_traffic_filtering=True,id=5f1e8fd9-8c1e-4815-9320-fe039c91101f,network=Network(05788b0f-d11b-44bb-b774-65ec62daceda),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5f1e8fd9-8c')
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:81:23,bridge_name='br-int',has_traffic_filtering=True,id=d9656c82-57df-4891-9c78-531de3f2c5aa,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9656c82-57') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:81:23,bridge_name='br-int',has_traffic_filtering=True,id=d9656c82-57df-4891-9c78-531de3f2c5aa,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9656c82-57') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9656c82-57, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd39e85a-90f8-4d87-bbe5-a4f7c9efb1ca) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: INFO os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:81:23,bridge_name='br-int',has_traffic_filtering=True,id=d9656c82-57df-4891-9c78-531de3f2c5aa,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9656c82-57')
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-16T00:44:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1630375806',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1630375806',id=21,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOCe74HweArfAj2mpGSfF0o1nHi96GZhE3e/tNTGmrP8/G2v85N4Fp3wIHj4CD6cGFTXy00JvOAoPN8Dodf8CL5DcwloKmW4ydSFzeNleY3pHCWlSO2M4hqP77N2tvtL4w==',key_name='tempest-keypair-881258109',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='02b8f62ebb8e4b4c9586b1092aabec74',ramdisk_id='',reservation_id='r-1gwau5e1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1314648939',owner_user_name='tempest-TaggedBootDevicesTest-1314648939-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='38b40689c2324d48bdf1f8ec8d4dc573',uuid=535e7401-0fb4-4e12-9110-515c63fd32c0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converting VIF {"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=605e5626-2a1e-4c78-8781-6bfd370354af,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605e5626-2a') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=605e5626-2a1e-4c78-8781-6bfd370354af,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605e5626-2a') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap605e5626-2a, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:36 user nova-compute[75826]: WARNING nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-950ac11c-60e7-4772-ab1f-51235827d355 for instance with vm_state active and task_state deleting.
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-09a45f64-c713-4faf-b030-9a71edc2bfe5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-unplugged-09a45f64-c713-4faf-b030-9a71edc2bfe5 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-09a45f64-c713-4faf-b030-9a71edc2bfe5 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-09a45f64-c713-4faf-b030-9a71edc2bfe5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-09a45f64-c713-4faf-b030-9a71edc2bfe5 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:36 user nova-compute[75826]: WARNING nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-09a45f64-c713-4faf-b030-9a71edc2bfe5 for instance with vm_state active and task_state deleting.
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-3753c6de-ba1a-4839-81db-e9920a6b815f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-unplugged-3753c6de-ba1a-4839-81db-e9920a6b815f {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-3753c6de-ba1a-4839-81db-e9920a6b815f for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-3753c6de-ba1a-4839-81db-e9920a6b815f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-3753c6de-ba1a-4839-81db-e9920a6b815f {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:36 user nova-compute[75826]: WARNING nova.compute.manager [req-87f0d94d-d645-4036-93ec-7a784d848fcf req-266006c7-7ee0-48a7-9971-30211a07159c service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-3753c6de-ba1a-4839-81db-e9920a6b815f for instance with vm_state active and task_state deleting.
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50eb92fe-2d7e-4c56-8076-c7501ef1e51a) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:36 user nova-compute[75826]: INFO os_vif [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:d0:6e,bridge_name='br-int',has_traffic_filtering=True,id=605e5626-2a1e-4c78-8781-6bfd370354af,network=Network(26c83806-f30e-4998-8c7b-ab3a99af244e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap605e5626-2a')
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JUnsTDdi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:36 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-48fe0ba2-aa43-4bed-a351-b64aa5fe47d7 req-fdd2cb03-fe4b-466a-88b4-394a78d00348 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-44813b22-4904-4534-9674-14220b2ee743 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-48fe0ba2-aa43-4bed-a351-b64aa5fe47d7 req-fdd2cb03-fe4b-466a-88b4-394a78d00348 service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-48fe0ba2-aa43-4bed-a351-b64aa5fe47d7 req-fdd2cb03-fe4b-466a-88b4-394a78d00348 service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-48fe0ba2-aa43-4bed-a351-b64aa5fe47d7 req-fdd2cb03-fe4b-466a-88b4-394a78d00348 service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-48fe0ba2-aa43-4bed-a351-b64aa5fe47d7 req-fdd2cb03-fe4b-466a-88b4-394a78d00348 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-44813b22-4904-4534-9674-14220b2ee743 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:36 user nova-compute[75826]: WARNING nova.compute.manager [req-48fe0ba2-aa43-4bed-a351-b64aa5fe47d7 req-fdd2cb03-fe4b-466a-88b4-394a78d00348 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-44813b22-4904-4534-9674-14220b2ee743 for instance with vm_state active and task_state deleting.
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85f7e9f-fcc8-47dc-89ce-1e433fdc1500]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:46:36 user nova-compute[75826]: No targets found.
Nov 16 00:46:36 user nova-compute[75826]: iSNS:
Nov 16 00:46:36 user nova-compute[75826]: No targets found.
Nov 16 00:46:36 user nova-compute[75826]: STATIC:
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: FIRMWARE:
Nov 16 00:46:36 user nova-compute[75826]: No targets found.
Nov 16 00:46:36 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:46:36 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:46:36 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd4f413-05cb-4962-bc8b-5a8d0e817203]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c21809-b8d2-4327-a740-1e2a17ae7d71]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:36 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:36 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb475d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a'): ({'sdc'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Removing single pathed devices sdc {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[837f05ca-e7f3-4a96-9ba2-25513e433e88]: (4, ('path checker states:\nup                  10\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f8b983-bd63-475d-b6b7-b255efc16de6]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Flushing IO for device /dev/sdc {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59d7225-3927-463c-ad0f-97759a894f62]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c580cf-8970-47e5-8d18-bd5d330b0f93]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[300729e4-ca43-425d-ae6d-4de2327f5071]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-5f1e8fd9-8c1e-4815-9320-fe039c91101f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-5f1e8fd9-8c1e-4815-9320-fe039c91101f {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:36 user nova-compute[75826]: WARNING nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-5f1e8fd9-8c1e-4815-9320-fe039c91101f for instance with vm_state active and task_state deleting.
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-d9656c82-57df-4891-9c78-531de3f2c5aa {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-unplugged-d9656c82-57df-4891-9c78-531de3f2c5aa {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-d9656c82-57df-4891-9c78-531de3f2c5aa for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-d9656c82-57df-4891-9c78-531de3f2c5aa {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-d9656c82-57df-4891-9c78-531de3f2c5aa {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:36 user nova-compute[75826]: WARNING nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-d9656c82-57df-4891-9c78-531de3f2c5aa for instance with vm_state active and task_state deleting.
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-605e5626-2a1e-4c78-8781-6bfd370354af {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-unplugged-605e5626-2a1e-4c78-8781-6bfd370354af {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-unplugged-605e5626-2a1e-4c78-8781-6bfd370354af for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-plugged-605e5626-2a1e-4c78-8781-6bfd370354af {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Acquiring lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] No waiting events found dispatching network-vif-plugged-605e5626-2a1e-4c78-8781-6bfd370354af {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:36 user nova-compute[75826]: WARNING nova.compute.manager [req-eafece76-166e-471d-8e52-ad0af18f7b86 req-2b42e5e6-1024-4837-846d-892d9b08486b service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received unexpected event network-vif-plugged-605e5626-2a1e-4c78-8781-6bfd370354af for instance with vm_state active and task_state deleting.
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3881abf-0cb6-4121-882a-a6c05ed23910]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a, portal: 172.16.0.220,3260]
Nov 16 00:46:36 user nova-compute[75826]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a, portal: 172.16.0.220,3260] successful.
Nov 16 00:46:36 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae16302-65c4-4d3a-b525-4e1c7260ed1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f00dd5-63b0-4bcd-a344-a3b230f9feb9]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] <== disconnect_volume: return (432ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hLYGFuOX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:36 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2266c3-0cdb-4bf3-9ab1-ad2213a68529]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:46:36 user nova-compute[75826]: No targets found.
Nov 16 00:46:36 user nova-compute[75826]: iSNS:
Nov 16 00:46:36 user nova-compute[75826]: No targets found.
Nov 16 00:46:36 user nova-compute[75826]: STATIC:
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f
Nov 16 00:46:36 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:36 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:36 user nova-compute[75826]: FIRMWARE:
Nov 16 00:46:36 user nova-compute[75826]: No targets found.
Nov 16 00:46:36 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:46:36 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:46:36 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeae04ce-7a30-4181-ae62-7c4917f850f1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f1c2366-18b5-48cc-be3a-c4a7efcda46b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:36 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:36 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:36 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb413b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3'): ({'sdd'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Removing single pathed devices sdd {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:46:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[04223589-bb5f-4c43-b028-77a088049714]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9040ec57-8ae9-44cb-a74f-31372695d5f5]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Flushing IO for device /dev/sdd {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d952b135-ed99-4118-a59e-b474a8b6e9e3]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efda873-5715-449b-8bd0-2d6e38951b41]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee6b812-6127-4eb4-9d3b-1f0bc61d292a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8f571f-cf60-4818-8f9b-c1dafcbcdf21]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3, portal: 172.16.0.220,3260]
Nov 16 00:46:37 user nova-compute[75826]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3, portal: 172.16.0.220,3260] successful.
Nov 16 00:46:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c135a70-4e99-4e05-bce1-847f292dcbd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[90707959-2610-4de7-952a-dbee919eec6c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] <== disconnect_volume: return (350ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSDzPcVK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:37 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[12af5b63-683a-4b9f-99fe-d4929667f665]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:46:37 user nova-compute[75826]: No targets found.
Nov 16 00:46:37 user nova-compute[75826]: iSNS:
Nov 16 00:46:37 user nova-compute[75826]: No targets found.
Nov 16 00:46:37 user nova-compute[75826]: STATIC:
Nov 16 00:46:37 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:46:37 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:37 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:37 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a
Nov 16 00:46:37 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:37 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:37 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:46:37 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:37 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:37 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:46:37 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:37 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:37 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f
Nov 16 00:46:37 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:37 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:37 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:46:37 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:37 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:37 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:46:37 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:37 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:37 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f
Nov 16 00:46:37 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:37 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:37 user nova-compute[75826]: FIRMWARE:
Nov 16 00:46:37 user nova-compute[75826]: No targets found.
Nov 16 00:46:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:46:37 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:46:37 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[56028cde-2fb0-4f35-bea1-453b366cc1f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e71b073-19c1-4b6c-b884-d6e392554a31]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:37 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb413b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a'): ({'sdf'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Removing single pathed devices sdf {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a909af-d107-4e93-973b-4b5cc2e7af51]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b91738b-44d4-4921-8f95-82dead6b6b22]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Flushing IO for device /dev/sdf {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[690e5709-0751-46d9-b28e-1048482ee242]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2c2f3e-8c92-438e-807d-aa1ab938da06]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5be68126-c125-441d-8f82-4c474b7ce768" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG nova.objects.instance [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lazy-loading 'flavor' on Instance uuid 5be68126-c125-441d-8f82-4c474b7ce768 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cafb8bcc-f45a-4931-84d5-428597b82803]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Ignoring supplied device name: /dev/vdb
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5be68126-c125-441d-8f82-4c474b7ce768" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.080s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[11cb090a-055e-4474-8c91-ce4349e9072f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a, portal: 172.16.0.220,3260]
Nov 16 00:46:37 user nova-compute[75826]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a, portal: 172.16.0.220,3260] successful.
Nov 16 00:46:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ca18b93-8ea3-4ffa-9d15-2da3cdf66c0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd53d57b-f79c-48d9-a22d-63d9d45e4666]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] <== disconnect_volume: return (373ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:46:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Deleting instance files /opt/stack/data/nova/instances/535e7401-0fb4-4e12-9110-515c63fd32c0_del
Nov 16 00:46:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Deletion of /opt/stack/data/nova/instances/535e7401-0fb4-4e12-9110-515c63fd32c0_del complete
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5be68126-c125-441d-8f82-4c474b7ce768" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:37 user nova-compute[75826]: INFO nova.compute.manager [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Attaching volume 8f36b8f0-2961-421f-ad43-26c0475620af to /dev/vdb
Nov 16 00:46:37 user nova-compute[75826]: INFO nova.compute.manager [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Took 3.82 seconds to destroy the instance on the hypervisor.
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.utils [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d027e47d-5a51-47d3-af20-022ad020d1b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd868121-da76-4c9c-acf0-c007131b517a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b247adb-6ee2-4315-bfed-149d2a504d68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f542f9c-7687-4a86-9a33-7fe16bc0d2ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:46:37 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:46:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35d423c-b7d5-4b15-8ac4-1be9f706b4cb]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG os_brick.utils [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:37 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Updating existing volume attachment record: 74be69cd-52ac-499f-a7f1-7c595fb67828 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:46:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-b3d41b24-9261-47e2-b90f-ff0ef06aead5 req-690a90ce-2d92-4f6b-abb5-bc6b1abbaac6 service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received event network-changed-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-b3d41b24-9261-47e2-b90f-ff0ef06aead5 req-690a90ce-2d92-4f6b-abb5-bc6b1abbaac6 service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Refreshing instance network info cache due to event network-changed-bfa57e78-a3df-44e1-9268-e37a5d006931. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:46:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b3d41b24-9261-47e2-b90f-ff0ef06aead5 req-690a90ce-2d92-4f6b-abb5-bc6b1abbaac6 service nova] Acquiring lock "refresh_cache-5be68126-c125-441d-8f82-4c474b7ce768" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:46:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b3d41b24-9261-47e2-b90f-ff0ef06aead5 req-690a90ce-2d92-4f6b-abb5-bc6b1abbaac6 service nova] Acquired lock "refresh_cache-5be68126-c125-441d-8f82-4c474b7ce768" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:46:38 user nova-compute[75826]: DEBUG nova.network.neutron [req-b3d41b24-9261-47e2-b90f-ff0ef06aead5 req-690a90ce-2d92-4f6b-abb5-bc6b1abbaac6 service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Refreshing network info cache for port bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:46:39 user nova-compute[75826]: DEBUG nova.network.neutron [req-b3d41b24-9261-47e2-b90f-ff0ef06aead5 req-690a90ce-2d92-4f6b-abb5-bc6b1abbaac6 service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Updated VIF entry in instance network info cache for port bfa57e78-a3df-44e1-9268-e37a5d006931. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:46:39 user nova-compute[75826]: DEBUG nova.network.neutron [req-b3d41b24-9261-47e2-b90f-ff0ef06aead5 req-690a90ce-2d92-4f6b-abb5-bc6b1abbaac6 service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Updating instance_info_cache with network_info: [{"id": "bfa57e78-a3df-44e1-9268-e37a5d006931", "address": "fa:16:3e:d9:35:e0", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa57e78-a3", "ovs_interfaceid": "bfa57e78-a3df-44e1-9268-e37a5d006931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b3d41b24-9261-47e2-b90f-ff0ef06aead5 req-690a90ce-2d92-4f6b-abb5-bc6b1abbaac6 service nova] Releasing lock "refresh_cache-5be68126-c125-441d-8f82-4c474b7ce768" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:46:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-00f7f29d-e14c-405a-b00b-5127d4b830b1 req-e58c1330-219d-4800-a291-5bc86eb96e48 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-deleted-3753c6de-ba1a-4839-81db-e9920a6b815f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:39 user nova-compute[75826]: INFO nova.compute.manager [req-00f7f29d-e14c-405a-b00b-5127d4b830b1 req-e58c1330-219d-4800-a291-5bc86eb96e48 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Neutron deleted interface 3753c6de-ba1a-4839-81db-e9920a6b815f; detaching it from the instance and deleting it from the info cache
Nov 16 00:46:39 user nova-compute[75826]: DEBUG nova.network.neutron [req-00f7f29d-e14c-405a-b00b-5127d4b830b1 req-e58c1330-219d-4800-a291-5bc86eb96e48 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating instance_info_cache with network_info: [{"id": "950ac11c-60e7-4772-ab1f-51235827d355", "address": "fa:16:3e:9c:63:6f", "network": {"id": "72c7f3c4-3d7f-4a1c-82b5-acee3c142fcf", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-711726094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.61", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950ac11c-60", "ovs_interfaceid": "950ac11c-60e7-4772-ab1f-51235827d355", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-00f7f29d-e14c-405a-b00b-5127d4b830b1 req-e58c1330-219d-4800-a291-5bc86eb96e48 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Detach interface failed, port_id=3753c6de-ba1a-4839-81db-e9920a6b815f, reason: Instance 535e7401-0fb4-4e12-9110-515c63fd32c0 could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG nova.compute.manager [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBykUMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c67f025-987e-435c-b1d9-7936832fe72b', 'attached_at': '', 'detached_at': '', 'volume_id': '628626d1-3245-4dbc-983e-72c3f1f3a39b', 'serial': '628626d1-3245-4dbc-983e-72c3f1f3a39b'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aeZEyIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': 'cb84881a-32e7-4f03-bc79-315eff84a25f'}, 'status': 'reserved', 'instance': '7c67f025-987e-435c-b1d9-7936832fe72b', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb84881a-32e7-4f03-bc79-315eff84a25f', 'serial'} {{(pid=75826) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBykUMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:41 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:41 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:41 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb123ff1-d050-44a0-91e1-2e9d6a447402]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:46:41 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[38501df8-fb3a-403c-bacf-df34259b0a87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b] added
Nov 16 00:46:41 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e26539-9c5f-4edd-9130-f288ce4f6e40]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88f4101-eda4-4a0e-b6f0-27309e06cd8c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBykUMID {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cBykUMID" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2bd4e9-d339-4b68-9bdf-02fab33c7d7e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cBykUMID'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[567b340e-8502-4e03-bd75-3cfb05bb4c85]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8a834c-cac7-4331-a2c4-cd2c6d9a4392]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:41 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:41 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cd0fe4-7dc0-4e72-bb1b-a398cd813af2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260]
Nov 16 00:46:41 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260] successful.
Nov 16 00:46:41 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-a262bb1c-b0d6-49d1-ac81-2623b1f8b2d2 req-72f5d2b0-e3ed-4b1b-b5dd-8659be12e1f3 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-deleted-950ac11c-60e7-4772-ab1f-51235827d355 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:41 user nova-compute[75826]: INFO nova.compute.manager [req-a262bb1c-b0d6-49d1-ac81-2623b1f8b2d2 req-72f5d2b0-e3ed-4b1b-b5dd-8659be12e1f3 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Neutron deleted interface 950ac11c-60e7-4772-ab1f-51235827d355; detaching it from the instance and deleting it from the info cache
Nov 16 00:46:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-a262bb1c-b0d6-49d1-ac81-2623b1f8b2d2 req-72f5d2b0-e3ed-4b1b-b5dd-8659be12e1f3 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating instance_info_cache with network_info: [{"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "address": "fa:16:3e:44:8d:47", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5f1e8fd9-8c", "ovs_interfaceid": "5f1e8fd9-8c1e-4815-9320-fe039c91101f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f73928-73d9-4191-a10d-e1122a651e89]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-a262bb1c-b0d6-49d1-ac81-2623b1f8b2d2 req-72f5d2b0-e3ed-4b1b-b5dd-8659be12e1f3 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Detach interface failed, port_id=950ac11c-60e7-4772-ab1f-51235827d355, reason: Instance 535e7401-0fb4-4e12-9110-515c63fd32c0 could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-a262bb1c-b0d6-49d1-ac81-2623b1f8b2d2 req-72f5d2b0-e3ed-4b1b-b5dd-8659be12e1f3 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-deleted-5f1e8fd9-8c1e-4815-9320-fe039c91101f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:41 user nova-compute[75826]: INFO nova.compute.manager [req-a262bb1c-b0d6-49d1-ac81-2623b1f8b2d2 req-72f5d2b0-e3ed-4b1b-b5dd-8659be12e1f3 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Neutron deleted interface 5f1e8fd9-8c1e-4815-9320-fe039c91101f; detaching it from the instance and deleting it from the info cache
Nov 16 00:46:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-a262bb1c-b0d6-49d1-ac81-2623b1f8b2d2 req-72f5d2b0-e3ed-4b1b-b5dd-8659be12e1f3 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating instance_info_cache with network_info: [{"id": "44813b22-4904-4534-9674-14220b2ee743", "address": "fa:16:3e:11:39:58", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.250", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44813b22-49", "ovs_interfaceid": "44813b22-4904-4534-9674-14220b2ee743", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "address": "fa:16:3e:7e:e2:cc", "network": {"id": "05788b0f-d11b-44bb-b774-65ec62daceda", "bridge": "br-int", "label": "tempest-device-tagging-net1-832819478", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap09a45f64-c7", "ovs_interfaceid": "09a45f64-c713-4faf-b030-9a71edc2bfe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d9656c82-57df-4891-9c78-531de3f2c5aa", "address": "fa:16:3e:88:81:23", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9656c82-57", "ovs_interfaceid": "d9656c82-57df-4891-9c78-531de3f2c5aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "605e5626-2a1e-4c78-8781-6bfd370354af", "address": "fa:16:3e:f2:d0:6e", "network": {"id": "26c83806-f30e-4998-8c7b-ab3a99af244e", "bridge": "br-int", "label": "tempest-device-tagging-net2-52112237", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "02b8f62ebb8e4b4c9586b1092aabec74", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap605e5626-2a", "ovs_interfaceid": "605e5626-2a1e-4c78-8781-6bfd370354af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8da17f-494c-4857-85d1-907c1ab3544f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:41 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:41 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:41 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-a262bb1c-b0d6-49d1-ac81-2623b1f8b2d2 req-72f5d2b0-e3ed-4b1b-b5dd-8659be12e1f3 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Detach interface failed, port_id=5f1e8fd9-8c1e-4815-9320-fe039c91101f, reason: Instance 535e7401-0fb4-4e12-9110-515c63fd32c0 could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca6a9ba-f59f-438b-b15b-6c0340ee8bfc]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:46:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBykUMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-db495605-f54e-4d2c-a401-ca644b4f8cc0 req-7db08026-10b1-4377-82aa-aa7f4cc615aa service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Received event network-changed-9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-db495605-f54e-4d2c-a401-ca644b4f8cc0 req-7db08026-10b1-4377-82aa-aa7f4cc615aa service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Refreshing instance network info cache due to event network-changed-9eca4e57-6005-41bb-b05b-3fb5793ffc88. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-db495605-f54e-4d2c-a401-ca644b4f8cc0 req-7db08026-10b1-4377-82aa-aa7f4cc615aa service nova] Acquiring lock "refresh_cache-eeb0e320-431c-44ad-bbb9-3eda75234ed1" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-db495605-f54e-4d2c-a401-ca644b4f8cc0 req-7db08026-10b1-4377-82aa-aa7f4cc615aa service nova] Acquired lock "refresh_cache-eeb0e320-431c-44ad-bbb9-3eda75234ed1" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG nova.network.neutron [req-db495605-f54e-4d2c-a401-ca644b4f8cc0 req-7db08026-10b1-4377-82aa-aa7f4cc615aa service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Refreshing network info cache for port 9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:42 user nova-compute[75826]: INFO nova.compute.manager [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Terminating instance
Nov 16 00:46:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-2bc0ac92-4964-49c0-93b8-0220387c1e26 req-f5f918f3-7581-4caa-815c-07fe396b8203 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Received event network-vif-unplugged-9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2bc0ac92-4964-49c0-93b8-0220387c1e26 req-f5f918f3-7581-4caa-815c-07fe396b8203 service nova] Acquiring lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2bc0ac92-4964-49c0-93b8-0220387c1e26 req-f5f918f3-7581-4caa-815c-07fe396b8203 service nova] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2bc0ac92-4964-49c0-93b8-0220387c1e26 req-f5f918f3-7581-4caa-815c-07fe396b8203 service nova] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-2bc0ac92-4964-49c0-93b8-0220387c1e26 req-f5f918f3-7581-4caa-815c-07fe396b8203 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] No waiting events found dispatching network-vif-unplugged-9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-2bc0ac92-4964-49c0-93b8-0220387c1e26 req-f5f918f3-7581-4caa-815c-07fe396b8203 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Received event network-vif-unplugged-9eca4e57-6005-41bb-b05b-3fb5793ffc88 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:42 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Took 5.16 seconds to deallocate network for instance.
Nov 16 00:46:42 user nova-compute[75826]: DEBUG nova.network.neutron [req-db495605-f54e-4d2c-a401-ca644b4f8cc0 req-7db08026-10b1-4377-82aa-aa7f4cc615aa service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Updated VIF entry in instance network info cache for port 9eca4e57-6005-41bb-b05b-3fb5793ffc88. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG nova.network.neutron [req-db495605-f54e-4d2c-a401-ca644b4f8cc0 req-7db08026-10b1-4377-82aa-aa7f4cc615aa service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Updating instance_info_cache with network_info: [{"id": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "address": "fa:16:3e:a9:78:21", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4e57-60", "ovs_interfaceid": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-db495605-f54e-4d2c-a401-ca644b4f8cc0 req-7db08026-10b1-4377-82aa-aa7f4cc615aa service nova] Releasing lock "refresh_cache-eeb0e320-431c-44ad-bbb9-3eda75234ed1" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23439623262316330', 'path': '/dev/sdc'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439623262316330', 'path': '/dev/sdc'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG nova.objects.instance [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lazy-loading 'flavor' on Instance uuid 7c67f025-987e-435c-b1d9-7936832fe72b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:43 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Instance destroyed successfully.
Nov 16 00:46:43 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lazy-loading 'resources' on Instance uuid eeb0e320-431c-44ad-bbb9-3eda75234ed1 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:43:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-917628068',display_name='tempest-TestStampPattern-server-917628068',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-917628068',id=18,image_ref='182a3508-62d9-4ea2-ad79-8a25af60da10',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnVOKXX9r1n1SeXR18FAZ5ReiXMg6r0YfIpLL5KrVybqfFaIfm7SGvy2MKiB0irAegI0W1yk67LwVXLx0F4yvrQoFAmD1fY1rcoS5KnlcevqtmC0fE4TYt7AS0e05sCcw==',key_name='tempest-TestStampPattern-2032325257',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:43:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='151c8475c39a472b9f99d7b94752e148',ramdisk_id='',reservation_id='r-gsd162wh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25',image_min_disk='1',image_min_ram='0',image_owner_id='151c8475c39a472b9f99d7b94752e148',image_owner_project_name='tempest-TestStampPattern-1037297845',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1037297845-project-member',image_user_id='5562a4fee0d14187bcb346ba5a4634af',owner_project_name='tempest-TestStampPattern-1037297845',owner_user_name='tempest-TestStampPattern-1037297845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:44:00Z,user_data=None,user_id='5562a4fee0d14187bcb346ba5a4634af',uuid=eeb0e320-431c-44ad-bbb9-3eda75234ed1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "address": "fa:16:3e:a9:78:21", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4e57-60", "ovs_interfaceid": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Converting VIF {"id": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "address": "fa:16:3e:a9:78:21", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9eca4e57-60", "ovs_interfaceid": "9eca4e57-6005-41bb-b05b-3fb5793ffc88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a9:78:21,bridge_name='br-int',has_traffic_filtering=True,id=9eca4e57-6005-41bb-b05b-3fb5793ffc88,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4e57-60') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG os_vif [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:78:21,bridge_name='br-int',has_traffic_filtering=True,id=9eca4e57-6005-41bb-b05b-3fb5793ffc88,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4e57-60') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9eca4e57-60, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5bc8782c-b295-4a20-87a4-2b73dcedf001) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:43 user nova-compute[75826]: INFO os_vif [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a9:78:21,bridge_name='br-int',has_traffic_filtering=True,id=9eca4e57-6005-41bb-b05b-3fb5793ffc88,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9eca4e57-60')
Nov 16 00:46:43 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Deleting instance files /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1_del
Nov 16 00:46:43 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Deletion of /opt/stack/data/nova/instances/eeb0e320-431c-44ad-bbb9-3eda75234ed1_del complete
Nov 16 00:46:43 user nova-compute[75826]: INFO nova.compute.manager [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIwQEzMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:43 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:43 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:43 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:43 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Took 0.67 seconds to deallocate network for instance.
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae87c1a-1ef9-48c1-a81e-d98317d7accf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:46:43 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35ad6cb-7ac6-4522-90c4-b42a510c8397]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af] added
Nov 16 00:46:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c781191-681f-45d5-981b-f3f9ca96cf1d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-bbdf3e1a-eeb2-4b37-92be-90a512b286e9 req-e6089cf1-ff77-4a2e-a28f-f57622c603d6 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-deleted-d9656c82-57df-4891-9c78-531de3f2c5aa {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-bbdf3e1a-eeb2-4b37-92be-90a512b286e9 req-e6089cf1-ff77-4a2e-a28f-f57622c603d6 service nova] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Received event network-vif-deleted-605e5626-2a1e-4c78-8781-6bfd370354af {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-bbdf3e1a-eeb2-4b37-92be-90a512b286e9 req-e6089cf1-ff77-4a2e-a28f-f57622c603d6 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Received event network-vif-deleted-9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2eb6fde-0d7f-44b2-ae3f-0583e68187e1]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OIwQEzMN {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 75497472 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OIwQEzMN" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b42e7ba4-2bff-465b-a40c-ed8bc7ae46c3]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OIwQEzMN'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd51315-6167-4cbd-924a-094d0ad6dcdc]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[804651cd-9f2d-4b15-a659-08000c83a7ae]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:44 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:44 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51c54ac-1166-4d68-894f-e8118a125f82]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af, portal: 172.16.0.220,3260]
Nov 16 00:46:44 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af, portal: 172.16.0.220,3260] successful.
Nov 16 00:46:44 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8325ec0f-5a65-4522-9fcd-5a05ac9e19cc]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e71585-6aef-4d8f-8c2e-73ba1a948d8b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:46:44 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:44 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:46:44 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.529s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[40db3aaa-bd7a-4fc6-b59f-80a16fb3e521]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 175112192 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-54de7a4d-4a13-495c-ae5e-2dac45af765a req-a83bf91b-2ef9-4cab-bbc3-617f4c8888f6 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Received event network-vif-plugged-9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-54de7a4d-4a13-495c-ae5e-2dac45af765a req-a83bf91b-2ef9-4cab-bbc3-617f4c8888f6 service nova] Acquiring lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-54de7a4d-4a13-495c-ae5e-2dac45af765a req-a83bf91b-2ef9-4cab-bbc3-617f4c8888f6 service nova] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-54de7a4d-4a13-495c-ae5e-2dac45af765a req-a83bf91b-2ef9-4cab-bbc3-617f4c8888f6 service nova] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-54de7a4d-4a13-495c-ae5e-2dac45af765a req-a83bf91b-2ef9-4cab-bbc3-617f4c8888f6 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] No waiting events found dispatching network-vif-plugged-9eca4e57-6005-41bb-b05b-3fb5793ffc88 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:46:44 user nova-compute[75826]: WARNING nova.compute.manager [req-54de7a4d-4a13-495c-ae5e-2dac45af765a req-a83bf91b-2ef9-4cab-bbc3-617f4c8888f6 service nova] [instance: eeb0e320-431c-44ad-bbb9-3eda75234ed1] Received unexpected event network-vif-plugged-9eca4e57-6005-41bb-b05b-3fb5793ffc88 for instance with vm_state deleted and task_state None.
Nov 16 00:46:44 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:46:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.951s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:44 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Deleted allocations for instance eeb0e320-431c-44ad-bbb9-3eda75234ed1
Nov 16 00:46:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 238026752 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0f253d6-ec7b-4652-9d59-93fd6da7c35b tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "eeb0e320-431c-44ad-bbb9-3eda75234ed1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.870s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:45 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:46:45 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIwQEzMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:46:45 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.572s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:45 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] <== connect_volume: return (1574ms) {'type': 'block', 'scsi_wwn': '26433383264306166', 'path': '/dev/sdd'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433383264306166', 'path': '/dev/sdd'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:46:45 user nova-compute[75826]: DEBUG nova.objects.instance [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lazy-loading 'flavor' on Instance uuid 5be68126-c125-441d-8f82-4c474b7ce768 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:46:45 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:46:45 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 00:46:45 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:46:45 user nova-compute[75826]:   <serial>8f36b8f0-2961-421f-ad43-26c0475620af</serial>
Nov 16 00:46:45 user nova-compute[75826]: </disk>
Nov 16 00:46:45 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:46:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 355467264 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:46:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:46:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] No VIF found with MAC fa:16:3e:d9:35:e0, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:46:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 442499072 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8b007ca2-10a3-46c2-8c33-9159a0574dce tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5be68126-c125-441d-8f82-4c474b7ce768" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.426s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:46 user nova-compute[75826]: INFO nova.compute.manager [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] [instance: 535e7401-0fb4-4e12-9110-515c63fd32c0] Took 3.39 seconds to detach 3 volumes for instance.
Nov 16 00:46:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 591396864 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:46 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:46:46 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:46:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.543s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:46 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Deleted allocations for instance 535e7401-0fb4-4e12-9110-515c63fd32c0
Nov 16 00:46:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f70016e0-3f66-40da-8a29-11483ca05cc1 tempest-TaggedBootDevicesTest-1314648939 tempest-TaggedBootDevicesTest-1314648939-project-member] Lock "535e7401-0fb4-4e12-9110-515c63fd32c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 13.142s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 676331520 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 851443712 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 958398464 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:48 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1621d261-aa12-4e57-a74e-fe565d921320 is timed out.
Nov 16 00:46:48 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Successfully detached device vdb from instance 1621d261-aa12-4e57-a74e-fe565d921320 from the live domain config.
Nov 16 00:46:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uXwoKVSP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdk'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:48 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37d960c-d719-4d4b-9b02-681b53f79c59]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:46:48 user nova-compute[75826]: No targets found.
Nov 16 00:46:48 user nova-compute[75826]: iSNS:
Nov 16 00:46:48 user nova-compute[75826]: No targets found.
Nov 16 00:46:48 user nova-compute[75826]: STATIC:
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: FIRMWARE:
Nov 16 00:46:48 user nova-compute[75826]: No targets found.
Nov 16 00:46:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:46:48 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:46:48 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[670ef248-06e2-4256-b339-760d8882a8c5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7542e8c0-db10-406e-90f6-b6576ab37b52]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:46:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:46:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd945308b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f'): ({'sdk'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Removing single pathed devices sdk {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4798c9d-531f-4e66-bd79-29260f7325de]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdk {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdk" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91cdc06-4ecf-456a-a45c-5d187e6c2709]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Flushing IO for device /dev/sdk {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdk {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdk" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ade5f08-7279-479b-a931-ce281d793b95]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdk/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdk/device/delete" returned: 0 in 0.036s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a79e0de-8cc2-423c-b166-65fc35c19d85]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Checking to see if SCSI volumes sdk have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] SCSI volumes sdk have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7fe2ee-ee46-48d7-8a35-9b69a2086430]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1427ca-fd02-4f2d-b9ff-29f1b09f61b0]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f, portal: 172.16.0.220,3260]
Nov 16 00:46:48 user nova-compute[75826]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f, portal: 172.16.0.220,3260] successful.
Nov 16 00:46:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a3a56e5-5c3b-4a74-bbb2-dc9cf0c3f81f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5448df-95ac-489f-844e-2355fda1a6fe]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] <== disconnect_volume: return (365ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aeZEyIYH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdl', 'volume_id': 'cb84881a-32e7-4f03-bc79-315eff84a25f'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:46:48 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e102311-f3a7-4bad-b694-2bf667854c6c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:46:48 user nova-compute[75826]: No targets found.
Nov 16 00:46:48 user nova-compute[75826]: iSNS:
Nov 16 00:46:48 user nova-compute[75826]: No targets found.
Nov 16 00:46:48 user nova-compute[75826]: STATIC:
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af
Nov 16 00:46:48 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:46:48 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:46:48 user nova-compute[75826]: FIRMWARE:
Nov 16 00:46:48 user nova-compute[75826]: No targets found.
Nov 16 00:46:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:46:48 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:46:48 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7adc0c56-8de5-4825-9d20-7d9baa1dab07]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a38c9751-6a5a-4a24-a1f3-39289557be5b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:46:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:46:48 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:46:48 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd94532ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f'): ({'sdl'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Removing single pathed devices sdl {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[271c0ebe-1dbb-4930-8e71-ce37a80dcfc5]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdl {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdl" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a09488-a5b5-4963-8ea1-fa5afac0a67a]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Flushing IO for device /dev/sdl {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdl {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdl" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee534cd-33fe-4dbd-83ec-f9e554cac460]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdl/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdl/device/delete" returned: 0 in 0.045s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[70cec9fa-9cef-4d4b-b001-bbc273177a20]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Checking to see if SCSI volumes sdl have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] SCSI volumes sdl have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac888a8-3971-4320-aaa7-dd8f5ed3aeb4]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7158d0-0e83-4f31-ae98-57816fcf7ba9]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f, portal: 172.16.0.220,3260]
Nov 16 00:46:49 user nova-compute[75826]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f, portal: 172.16.0.220,3260] successful.
Nov 16 00:46:49 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb84881a-32e7-4f03-bc79-315eff84a25f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aea5c00-dd9d-477c-aefc-5e7bf67b1bea]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] <== disconnect_volume: return (345ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG nova.compute.manager [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBykUMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '7c67f025-987e-435c-b1d9-7936832fe72b', 'attached_at': '', 'detached_at': '', 'volume_id': '628626d1-3245-4dbc-983e-72c3f1f3a39b', 'serial'} {{(pid=75826) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG nova.compute.manager [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] swap_volume: removing Cinder connection for volume cb84881a-32e7-4f03-bc79-315eff84a25f {{(pid=75826) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG nova.objects.instance [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lazy-loading 'flavor' on Instance uuid 1621d261-aa12-4e57-a74e-fe565d921320 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-da841af7-98ec-43f8-a416-d1ef5568ca9d tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "1621d261-aa12-4e57-a74e-fe565d921320" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.146s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG nova.compute.manager [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] swap_volume: Updating volume cb84881a-32e7-4f03-bc79-315eff84a25f BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "cBykUMID", "auth_password": "zbl5IFJvi7eTEH", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "628626d1-3245-4dbc-983e-72c3f1f3a39b"}, "status": "reserved", "instance": "7c67f025-987e-435c-b1d9-7936832fe72b", "attached_at": "", "detached_at": "", "volume_id": "628626d1-3245-4dbc-983e-72c3f1f3a39b", "serial": "628626d1-3245-4dbc-983e-72c3f1f3a39b"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '628626d1-3245-4dbc-983e-72c3f1f3a39b', 'no_device': None, 'attachment_id': '3c0aef32-c066-4149-abb6-5cbb03905cf0'} {{(pid=75826) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 16 00:46:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-80c86e34-1e08-4ddb-82dd-eec79d666505 tempest-TestVolumeSwap-631629023 tempest-TestVolumeSwap-631629023-project-admin] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 14.527s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:46:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "7c67f025-987e-435c-b1d9-7936832fe72b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:46:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:46:51 user nova-compute[75826]: INFO nova.compute.manager [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Detaching volume 628626d1-3245-4dbc-983e-72c3f1f3a39b
Nov 16 00:46:51 user nova-compute[75826]: INFO nova.virt.block_device [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Attempting to driver detach volume 628626d1-3245-4dbc-983e-72c3f1f3a39b from mountpoint /dev/vdb
Nov 16 00:46:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Attempting to detach device vdb from instance 7c67f025-987e-435c-b1d9-7936832fe72b from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:46:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:46:51 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:46:51 user nova-compute[75826]:   <source dev="/dev/sdc"/>
Nov 16 00:46:51 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:46:51 user nova-compute[75826]:   <serial>628626d1-3245-4dbc-983e-72c3f1f3a39b</serial>
Nov 16 00:46:51 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:46:51 user nova-compute[75826]: </disk>
Nov 16 00:46:51 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:46:51 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Successfully detached device vdb from instance 7c67f025-987e-435c-b1d9-7936832fe72b from the persistent domain config.
Nov 16 00:46:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7c67f025-987e-435c-b1d9-7936832fe72b from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:46:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:46:51 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:46:51 user nova-compute[75826]:   <source dev="/dev/sdc"/>
Nov 16 00:46:51 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:46:51 user nova-compute[75826]:   <serial>628626d1-3245-4dbc-983e-72c3f1f3a39b</serial>
Nov 16 00:46:51 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:46:51 user nova-compute[75826]: </disk>
Nov 16 00:46:51 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:46:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7c67f025-987e-435c-b1d9-7936832fe72b {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:46:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:57 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:46:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:46:59 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:46:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:00 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:47:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:47:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:47:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:47:00 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:47:00 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updating instance_info_cache with network_info: [{"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:47:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:47:00 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:47:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:47:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:47:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:05 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:47:05 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7367MB free_disk=25.201519012451172GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 298c8986-b91b-4f46-bcce-75e28bc02b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7c67f025-987e-435c-b1d9-7936832fe72b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 1621d261-aa12-4e57-a74e-fe565d921320 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 5be68126-c125-441d-8f82-4c474b7ce768 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:47:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:47:06 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:47:06 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:47:06 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:47:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.480s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5be68126-c125-441d-8f82-4c474b7ce768" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:06 user nova-compute[75826]: INFO nova.compute.manager [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Detaching volume 8f36b8f0-2961-421f-ad43-26c0475620af
Nov 16 00:47:06 user nova-compute[75826]: INFO nova.virt.block_device [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Attempting to driver detach volume 8f36b8f0-2961-421f-ad43-26c0475620af from mountpoint /dev/vdb
Nov 16 00:47:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Attempting to detach device vdb from instance 5be68126-c125-441d-8f82-4c474b7ce768 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:47:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:47:06 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:47:06 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 00:47:06 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:47:06 user nova-compute[75826]:   <serial>8f36b8f0-2961-421f-ad43-26c0475620af</serial>
Nov 16 00:47:06 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:47:06 user nova-compute[75826]: </disk>
Nov 16 00:47:06 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:47:06 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Successfully detached device vdb from instance 5be68126-c125-441d-8f82-4c474b7ce768 from the persistent domain config.
Nov 16 00:47:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5be68126-c125-441d-8f82-4c474b7ce768 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:47:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:47:06 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:47:06 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 00:47:06 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:47:06 user nova-compute[75826]:   <serial>8f36b8f0-2961-421f-ad43-26c0475620af</serial>
Nov 16 00:47:06 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:47:06 user nova-compute[75826]: </disk>
Nov 16 00:47:06 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:47:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5be68126-c125-441d-8f82-4c474b7ce768 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'flavor' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquired lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'info_cache' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG nova.objects.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG nova.network.neutron [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Updating instance_info_cache with network_info: [{"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Releasing lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:47:07 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Instance destroyed successfully.
Nov 16 00:47:07 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'resources' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG nova.objects.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1610404613',display_name='tempest-AttachVolumeTestJSON-server-1610404613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1610404613',id=17,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPd46vcTYm1IGljsZJY5d+bnsYtZu5mDPgxXnccpiKGtfwu7f4jNN4sCNE2xSEkbiGF7AI/QCdZlu654F87C0DsVVQp1j+jeloZ54u8nfEkpLHA8I7BQPi8srBhE2Ey6w==',key_name='tempest-keypair-1910536779',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:43:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='aa522b01f20c4d90bc4178e688319e7f',ramdisk_id='',reservation_id='r-tf175bq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1305137356',owner_user_name='tempest-AttachVolumeTestJSON-1305137356-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:45:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96797fc178ed4c2190f7a760b3bd30bd',uuid=298c8986-b91b-4f46-bcce-75e28bc02b5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converting VIF {"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG os_vif [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff64782d-04, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad9b5211-d3bc-46ca-8e77-62244bebeef3) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:07 user nova-compute[75826]: INFO os_vif [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04')
Nov 16 00:47:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xudMsJbB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:47:07 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:47:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c184f50-79dc-4e58-826a-1127ae9ec90a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:47:07 user nova-compute[75826]: No targets found.
Nov 16 00:47:07 user nova-compute[75826]: iSNS:
Nov 16 00:47:07 user nova-compute[75826]: No targets found.
Nov 16 00:47:07 user nova-compute[75826]: STATIC:
Nov 16 00:47:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:47:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:47:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:47:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b
Nov 16 00:47:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:47:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:47:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af
Nov 16 00:47:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:07 user nova-compute[75826]: FIRMWARE:
Nov 16 00:47:07 user nova-compute[75826]: No targets found.
Nov 16 00:47:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:47:07 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:47:07 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0dae2b8-47ff-4883-b534-a45ea0418db4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[aead6301-839b-4751-adb7-e022af9fc124]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:07 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:07 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:07 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:47:07 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:07 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:47:07 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:47:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:07 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:07 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:07 user nova-compute[75826]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:47:07 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:07 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:47:07 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:47:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb449b520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c'): ({'sdh'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Removing single pathed devices sdh {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[46606a5f-fe4d-469e-bf16-2d2ae481bd62]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4247833-70e4-463a-be69-dc856f40f309]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:07 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Flushing IO for device /dev/sdh {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02d7024-5dc7-402b-8b3a-c141ab625ccf]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f1ecf2-86a7-492c-8462-072d3fdfcd3a]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] SCSI volumes sdh have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[62546f83-bcb9-4c2c-96d8-1b628e391b0d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82fffb5-696d-4aba-95be-9e814d548845]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260]
Nov 16 00:47:08 user nova-compute[75826]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260] successful.
Nov 16 00:47:08 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7ae06d-5571-419f-979b-1e3dcc9be22d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] <== disconnect_volume: return (314ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Start _get_guest_xml network_info=[{"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '86a26875-290a-4b30-87ce-8ab063a01175', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xudMsJbB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '298c8986-b91b-4f46-bcce-75e28bc02b5f', 'attached_at': '', 'detached_at': '', 'volume_id': '614386b6-09ef-4bd9-b7ff-475392da7e4c', 'serial': '614386b6-09ef-4bd9-b7ff-475392da7e4c'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'numa_topology' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.objects.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:47:08 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:47:08 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'vcpu_model' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.objects.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xudMsJbB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:47:08 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:47:08 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:47:08 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9be59d2-ba8b-4f44-a670-aa892fa2a8bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:47:08 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d29749d-05ca-430c-a64d-6073bda5900f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c] added
Nov 16 00:47:08 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f405d77-2452-49f2-8ac4-5b40dd1d8114]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c99e63-e434-45f9-9e0c-38d637af36ba]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xudMsJbB {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xudMsJbB" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a85d220-f1d0-4ed8-8a78-d432ed0ae758]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xudMsJbB'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0465f113-1cc5-4b58-9723-7dcbce99d9dc]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[97967be4-3ef2-4224-99c5-d645c599892c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:47:08 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:47:08 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c136b9-4a41-413b-97bb-f433dd69b612]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260]
Nov 16 00:47:08 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260] successful.
Nov 16 00:47:08 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0c9e0a-6608-418a-aa6b-7ce8439f855a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7298a636-4d3e-4fa3-9113-10f5792d080b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:47:08 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:47:08 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:47:08 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[02bbc8df-050a-46cf-a805-b7f0e609b770]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:47:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xudMsJbB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:47:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:47:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23961316538346362', 'path': '/dev/sdf'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:47:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23961316538346362', 'path': '/dev/sdf'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:47:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1610404613',display_name='tempest-AttachVolumeTestJSON-server-1610404613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1610404613',id=17,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPd46vcTYm1IGljsZJY5d+bnsYtZu5mDPgxXnccpiKGtfwu7f4jNN4sCNE2xSEkbiGF7AI/QCdZlu654F87C0DsVVQp1j+jeloZ54u8nfEkpLHA8I7BQPi8srBhE2Ey6w==',key_name='tempest-keypair-1910536779',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:43:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='aa522b01f20c4d90bc4178e688319e7f',ramdisk_id='',reservation_id='r-tf175bq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1305137356',owner_user_name='tempest-AttachVolumeTestJSON-1305137356-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:45:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96797fc178ed4c2190f7a760b3bd30bd',uuid=298c8986-b91b-4f46-bcce-75e28bc02b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:47:09 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converting VIF {"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:09 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:09 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'pci_devices' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:09 user nova-compute[75826]: DEBUG nova.objects.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:47:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:47:09 user nova-compute[75826]:   <uuid>298c8986-b91b-4f46-bcce-75e28bc02b5f</uuid>
Nov 16 00:47:09 user nova-compute[75826]:   <name>instance-00000011</name>
Nov 16 00:47:09 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:47:09 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:47:09 user nova-compute[75826]:   <metadata>
Nov 16 00:47:09 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:47:09 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:47:09 user nova-compute[75826]:       <nova:name>tempest-AttachVolumeTestJSON-server-1610404613</nova:name>
Nov 16 00:47:09 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:47:08</nova:creationTime>
Nov 16 00:47:09 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:47:09 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:47:09 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:47:09 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:47:09 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:47:09 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:47:09 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:47:09 user nova-compute[75826]:       <nova:owner>
Nov 16 00:47:09 user nova-compute[75826]:         <nova:user uuid="96797fc178ed4c2190f7a760b3bd30bd">tempest-AttachVolumeTestJSON-1305137356-project-member</nova:user>
Nov 16 00:47:09 user nova-compute[75826]:         <nova:project uuid="aa522b01f20c4d90bc4178e688319e7f">tempest-AttachVolumeTestJSON-1305137356</nova:project>
Nov 16 00:47:09 user nova-compute[75826]:       </nova:owner>
Nov 16 00:47:09 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:47:09 user nova-compute[75826]:       <nova:ports>
Nov 16 00:47:09 user nova-compute[75826]:         <nova:port uuid="ff64782d-047b-4488-80c5-b8866a0c5037">
Nov 16 00:47:09 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 00:47:09 user nova-compute[75826]:         </nova:port>
Nov 16 00:47:09 user nova-compute[75826]:       </nova:ports>
Nov 16 00:47:09 user nova-compute[75826]:     </nova:instance>
Nov 16 00:47:09 user nova-compute[75826]:   </metadata>
Nov 16 00:47:09 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:47:09 user nova-compute[75826]:     <system>
Nov 16 00:47:09 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:47:09 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:47:09 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:47:09 user nova-compute[75826]:       <entry name="serial">298c8986-b91b-4f46-bcce-75e28bc02b5f</entry>
Nov 16 00:47:09 user nova-compute[75826]:       <entry name="uuid">298c8986-b91b-4f46-bcce-75e28bc02b5f</entry>
Nov 16 00:47:09 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:47:09 user nova-compute[75826]:     </system>
Nov 16 00:47:09 user nova-compute[75826]:   </sysinfo>
Nov 16 00:47:09 user nova-compute[75826]:   <os>
Nov 16 00:47:09 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:47:09 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:47:09 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:47:09 user nova-compute[75826]:   </os>
Nov 16 00:47:09 user nova-compute[75826]:   <features>
Nov 16 00:47:09 user nova-compute[75826]:     <acpi/>
Nov 16 00:47:09 user nova-compute[75826]:     <apic/>
Nov 16 00:47:09 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:47:09 user nova-compute[75826]:   </features>
Nov 16 00:47:09 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:47:09 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:47:09 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:47:09 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:47:09 user nova-compute[75826]:   </clock>
Nov 16 00:47:09 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:47:09 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:47:09 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:47:09 user nova-compute[75826]:   </cpu>
Nov 16 00:47:09 user nova-compute[75826]:   <devices>
Nov 16 00:47:09 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:47:09 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:47:09 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk"/>
Nov 16 00:47:09 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:47:09 user nova-compute[75826]:     </disk>
Nov 16 00:47:09 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:47:09 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:47:09 user nova-compute[75826]:       <source dev="/dev/sdf"/>
Nov 16 00:47:09 user nova-compute[75826]:       <target dev="vdb" bus="virtio"/>
Nov 16 00:47:09 user nova-compute[75826]:       <serial>614386b6-09ef-4bd9-b7ff-475392da7e4c</serial>
Nov 16 00:47:09 user nova-compute[75826]:     </disk>
Nov 16 00:47:09 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:47:09 user nova-compute[75826]:       <mac address="fa:16:3e:fc:58:e0"/>
Nov 16 00:47:09 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:47:09 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:47:09 user nova-compute[75826]:       <target dev="tapff64782d-04"/>
Nov 16 00:47:09 user nova-compute[75826]:     </interface>
Nov 16 00:47:09 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:47:09 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/console.log" append="off"/>
Nov 16 00:47:09 user nova-compute[75826]:     </serial>
Nov 16 00:47:09 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:47:09 user nova-compute[75826]:     <video>
Nov 16 00:47:09 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:47:09 user nova-compute[75826]:     </video>
Nov 16 00:47:09 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:47:09 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:47:09 user nova-compute[75826]:     </rng>
Nov 16 00:47:09 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:47:09 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:47:09 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:47:09 user nova-compute[75826]:     </memballoon>
Nov 16 00:47:09 user nova-compute[75826]:   </devices>
Nov 16 00:47:09 user nova-compute[75826]: </domain>
Nov 16 00:47:09 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:47:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'trusted_certs' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG nova.objects.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.168s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Cannot resize image /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'migration_context' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG nova.objects.base [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1610404613',display_name='tempest-AttachVolumeTestJSON-server-1610404613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1610404613',id=17,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPd46vcTYm1IGljsZJY5d+bnsYtZu5mDPgxXnccpiKGtfwu7f4jNN4sCNE2xSEkbiGF7AI/QCdZlu654F87C0DsVVQp1j+jeloZ54u8nfEkpLHA8I7BQPi8srBhE2Ey6w==',key_name='tempest-keypair-1910536779',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:43:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='aa522b01f20c4d90bc4178e688319e7f',ramdisk_id='',reservation_id='r-tf175bq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1305137356',owner_user_name='tempest-AttachVolumeTestJSON-1305137356-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:45:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96797fc178ed4c2190f7a760b3bd30bd',uuid=298c8986-b91b-4f46-bcce-75e28bc02b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converting VIF {"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG os_vif [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87081e3d-e6cc-58df-8179-db816c643a62', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff64782d-04, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff64782d-04, col_values=(('qos', UUID('a3d6363c-e057-4bdf-89ab-1876269b5989')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff64782d-04, col_values=(('external_ids', {'iface-id': 'ff64782d-047b-4488-80c5-b8866a0c5037', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:58:e0', 'vm-uuid': '298c8986-b91b-4f46-bcce-75e28bc02b5f'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:10 user nova-compute[75826]: INFO os_vif [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04')
Nov 16 00:47:11 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7c67f025-987e-435c-b1d9-7936832fe72b is timed out.
Nov 16 00:47:11 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Successfully detached device vdb from instance 7c67f025-987e-435c-b1d9-7936832fe72b from the live domain config.
Nov 16 00:47:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cBykUMID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': '628626d1-3245-4dbc-983e-72c3f1f3a39b'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:47:11 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b68dc4-ca46-455f-a671-973a6d288e84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:47:11 user nova-compute[75826]: No targets found.
Nov 16 00:47:11 user nova-compute[75826]: iSNS:
Nov 16 00:47:11 user nova-compute[75826]: No targets found.
Nov 16 00:47:11 user nova-compute[75826]: STATIC:
Nov 16 00:47:11 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:47:11 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:11 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:11 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:47:11 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:11 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:11 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:47:11 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:11 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:11 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b
Nov 16 00:47:11 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:11 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:11 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:47:11 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:11 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:11 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:47:11 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:11 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:11 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af
Nov 16 00:47:11 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:11 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:11 user nova-compute[75826]: FIRMWARE:
Nov 16 00:47:11 user nova-compute[75826]: No targets found.
Nov 16 00:47:11 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:47:11 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:47:11 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87f533f-2b28-4f95-9f0b-7b0a70479aa2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb505252-5221-4b12-b939-d903c5f4d7b3]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:11 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:11 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:11 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:11 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:47:11 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:47:11 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:47:11 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:11 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:11 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:11 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:11 user nova-compute[75826]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b (non-flash)
Nov 16 00:47:11 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:47:11 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:47:11 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd9435aef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b'): ({'sdc'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Removing single pathed devices sdc {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff58e34-4d7c-47af-a833-2830ecade357]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62182bf-8b56-45b3-94cf-90da3533bb91]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Flushing IO for device /dev/sdc {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bc3360-d0c5-4f0e-8408-15daceb1c519]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcfc0f1-0055-45fd-9d0f-7e5c0d9ffd17]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8f2527-3cf1-4361-bf63-fe537ea36aef]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-0aa739dd-cf87-4256-8e70-ef0dd7e4cdeb req-c6205247-879f-4c9c-8e2e-e22c4e83bbda service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0aa739dd-cf87-4256-8e70-ef0dd7e4cdeb req-c6205247-879f-4c9c-8e2e-e22c4e83bbda service nova] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0aa739dd-cf87-4256-8e70-ef0dd7e4cdeb req-c6205247-879f-4c9c-8e2e-e22c4e83bbda service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0aa739dd-cf87-4256-8e70-ef0dd7e4cdeb req-c6205247-879f-4c9c-8e2e-e22c4e83bbda service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-0aa739dd-cf87-4256-8e70-ef0dd7e4cdeb req-c6205247-879f-4c9c-8e2e-e22c4e83bbda service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] No waiting events found dispatching network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:11 user nova-compute[75826]: WARNING nova.compute.manager [req-0aa739dd-cf87-4256-8e70-ef0dd7e4cdeb req-c6205247-879f-4c9c-8e2e-e22c4e83bbda service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received unexpected event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 for instance with vm_state stopped and task_state powering-on.
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --logout" returned: 0 in 0.118s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4691a5-77c7-45df-a518-45fc9e969585]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260]
Nov 16 00:47:11 user nova-compute[75826]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b, portal: 172.16.0.220,3260] successful.
Nov 16 00:47:11 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:628626d1-3245-4dbc-983e-72c3f1f3a39b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5cfba3-bf16-42aa-a701-885504f4d344]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] <== disconnect_volume: return (400ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG nova.objects.instance [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lazy-loading 'flavor' on Instance uuid 7c67f025-987e-435c-b1d9-7936832fe72b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-09b185d4-75a1-4cb8-86c4-3c5851706e19 tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.738s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:47:13 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Instance rebooted successfully.
Nov 16 00:47:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d872c02b-a9a3-47f7-959c-e9d64d44b477 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:47:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-055aacde-4869-46c6-ab4c-439d62eb75d1 req-9a0a1257-a95b-4a24-b838-9e9821e2e9f7 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-055aacde-4869-46c6-ab4c-439d62eb75d1 req-9a0a1257-a95b-4a24-b838-9e9821e2e9f7 service nova] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-055aacde-4869-46c6-ab4c-439d62eb75d1 req-9a0a1257-a95b-4a24-b838-9e9821e2e9f7 service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-055aacde-4869-46c6-ab4c-439d62eb75d1 req-9a0a1257-a95b-4a24-b838-9e9821e2e9f7 service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-055aacde-4869-46c6-ab4c-439d62eb75d1 req-9a0a1257-a95b-4a24-b838-9e9821e2e9f7 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] No waiting events found dispatching network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:13 user nova-compute[75826]: WARNING nova.compute.manager [req-055aacde-4869-46c6-ab4c-439d62eb75d1 req-9a0a1257-a95b-4a24-b838-9e9821e2e9f7 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received unexpected event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 for instance with vm_state active and task_state None.
Nov 16 00:47:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "1621d261-aa12-4e57-a74e-fe565d921320" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "1621d261-aa12-4e57-a74e-fe565d921320" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "1621d261-aa12-4e57-a74e-fe565d921320-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "1621d261-aa12-4e57-a74e-fe565d921320-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "1621d261-aa12-4e57-a74e-fe565d921320-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:21 user nova-compute[75826]: INFO nova.compute.manager [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Terminating instance
Nov 16 00:47:21 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-8cb34165-e2b5-4c8a-ac6a-bd7127fa7885 req-187cb278-3084-4f1e-b5ef-1c79b763f4cf service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Received event network-vif-unplugged-8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8cb34165-e2b5-4c8a-ac6a-bd7127fa7885 req-187cb278-3084-4f1e-b5ef-1c79b763f4cf service nova] Acquiring lock "1621d261-aa12-4e57-a74e-fe565d921320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8cb34165-e2b5-4c8a-ac6a-bd7127fa7885 req-187cb278-3084-4f1e-b5ef-1c79b763f4cf service nova] Lock "1621d261-aa12-4e57-a74e-fe565d921320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8cb34165-e2b5-4c8a-ac6a-bd7127fa7885 req-187cb278-3084-4f1e-b5ef-1c79b763f4cf service nova] Lock "1621d261-aa12-4e57-a74e-fe565d921320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-8cb34165-e2b5-4c8a-ac6a-bd7127fa7885 req-187cb278-3084-4f1e-b5ef-1c79b763f4cf service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] No waiting events found dispatching network-vif-unplugged-8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-8cb34165-e2b5-4c8a-ac6a-bd7127fa7885 req-187cb278-3084-4f1e-b5ef-1c79b763f4cf service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Received event network-vif-unplugged-8b853c2c-b02a-49c8-a6a4-76106e6b2228 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:47:21 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Instance destroyed successfully.
Nov 16 00:47:21 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lazy-loading 'resources' on Instance uuid 1621d261-aa12-4e57-a74e-fe565d921320 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:44:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1100572401',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1100572401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1100572',id=20,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtjhRUFyVPRH/e/ktH+mUsT1uO8ko2e4zGpDkkSEbxU6DaxcHLjUIgjXct8lrxKqC5g0YUiPq+XEX5X+xsUjwv/NWvCIaFRqg5VQp0ow+hJ88U5WsF3bdOXYXptxvOtnw==',key_name='tempest-keypair-1594438920',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:44:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d405b224d90942d6bd3188f6df34dcd1',ramdisk_id='',reservation_id='r-1zsxveir',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1900025064',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:44:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5f385e70b9fe4413b9870116e2367547',uuid=1621d261-aa12-4e57-a74e-fe565d921320,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "address": "fa:16:3e:5f:1e:f8", "network": {"id": "637cf6bb-6dcf-437b-a8e5-77e95b66185e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422833898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d405b224d90942d6bd3188f6df34dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853c2c-b0", "ovs_interfaceid": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Converting VIF {"id": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "address": "fa:16:3e:5f:1e:f8", "network": {"id": "637cf6bb-6dcf-437b-a8e5-77e95b66185e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-422833898-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d405b224d90942d6bd3188f6df34dcd1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b853c2c-b0", "ovs_interfaceid": "8b853c2c-b02a-49c8-a6a4-76106e6b2228", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5f:1e:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b853c2c-b02a-49c8-a6a4-76106e6b2228,network=Network(637cf6bb-6dcf-437b-a8e5-77e95b66185e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853c2c-b0') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG os_vif [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:1e:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b853c2c-b02a-49c8-a6a4-76106e6b2228,network=Network(637cf6bb-6dcf-437b-a8e5-77e95b66185e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853c2c-b0') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b853c2c-b0, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72cf2284-cd90-4bd0-b733-b3f9ad8b8c61) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:21 user nova-compute[75826]: INFO os_vif [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5f:1e:f8,bridge_name='br-int',has_traffic_filtering=True,id=8b853c2c-b02a-49c8-a6a4-76106e6b2228,network=Network(637cf6bb-6dcf-437b-a8e5-77e95b66185e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b853c2c-b0')
Nov 16 00:47:21 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Deleting instance files /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320_del
Nov 16 00:47:21 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Deletion of /opt/stack/data/nova/instances/1621d261-aa12-4e57-a74e-fe565d921320_del complete
Nov 16 00:47:21 user nova-compute[75826]: INFO nova.compute.manager [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 16 00:47:21 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:47:21 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:47:22 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:22 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Took 0.72 seconds to deallocate network for instance.
Nov 16 00:47:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:23 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:47:23 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:47:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:23 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Deleted allocations for instance 1621d261-aa12-4e57-a74e-fe565d921320
Nov 16 00:47:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4972dfae-5811-4d09-8ee3-a863bf3222a8 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064 tempest-TestServerVolumeAttachScenarioOldVersion-1900025064-project-member] Lock "1621d261-aa12-4e57-a74e-fe565d921320" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.083s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-58ca4896-2f1e-4df7-9da5-147ef62f94b7 req-5b1b1754-712c-40fd-b734-1673319c2e7d service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Received event network-vif-plugged-8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-58ca4896-2f1e-4df7-9da5-147ef62f94b7 req-5b1b1754-712c-40fd-b734-1673319c2e7d service nova] Acquiring lock "1621d261-aa12-4e57-a74e-fe565d921320-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-58ca4896-2f1e-4df7-9da5-147ef62f94b7 req-5b1b1754-712c-40fd-b734-1673319c2e7d service nova] Lock "1621d261-aa12-4e57-a74e-fe565d921320-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-58ca4896-2f1e-4df7-9da5-147ef62f94b7 req-5b1b1754-712c-40fd-b734-1673319c2e7d service nova] Lock "1621d261-aa12-4e57-a74e-fe565d921320-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-58ca4896-2f1e-4df7-9da5-147ef62f94b7 req-5b1b1754-712c-40fd-b734-1673319c2e7d service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] No waiting events found dispatching network-vif-plugged-8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:23 user nova-compute[75826]: WARNING nova.compute.manager [req-58ca4896-2f1e-4df7-9da5-147ef62f94b7 req-5b1b1754-712c-40fd-b734-1673319c2e7d service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Received unexpected event network-vif-plugged-8b853c2c-b02a-49c8-a6a4-76106e6b2228 for instance with vm_state deleted and task_state None.
Nov 16 00:47:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-58ca4896-2f1e-4df7-9da5-147ef62f94b7 req-5b1b1754-712c-40fd-b734-1673319c2e7d service nova] [instance: 1621d261-aa12-4e57-a74e-fe565d921320] Received event network-vif-deleted-8b853c2c-b02a-49c8-a6a4-76106e6b2228 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:26 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5be68126-c125-441d-8f82-4c474b7ce768 is timed out.
Nov 16 00:47:26 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Successfully detached device vdb from instance 5be68126-c125-441d-8f82-4c474b7ce768 from the live domain config.
Nov 16 00:47:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIwQEzMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:47:26 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:47:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b0bc71-8d3f-4603-88dd-8df251b635be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:47:26 user nova-compute[75826]: No targets found.
Nov 16 00:47:26 user nova-compute[75826]: iSNS:
Nov 16 00:47:26 user nova-compute[75826]: No targets found.
Nov 16 00:47:26 user nova-compute[75826]: STATIC:
Nov 16 00:47:26 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:47:26 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:26 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:26 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:47:26 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:26 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:26 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:47:26 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:26 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:26 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:47:26 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:26 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:26 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:47:26 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:26 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:26 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af
Nov 16 00:47:26 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:26 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:26 user nova-compute[75826]: FIRMWARE:
Nov 16 00:47:26 user nova-compute[75826]: No targets found.
Nov 16 00:47:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:47:26 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:47:26 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a18dad-9011-48f4-a388-0425bb83423d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6027d917-e471-40cb-b492-6b8d25d4dab6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:26 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:26 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:26 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:26 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:47:26 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:47:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:26 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:26 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:26 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:26 user nova-compute[75826]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af (non-flash)
Nov 16 00:47:26 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:47:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd946f39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af'): ({'sdd'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Removing single pathed devices sdd {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e17e41-22ea-429d-b96d-111bd33a3c14]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e59d5f-11c1-439b-a4d6-c1518e5a3e70]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Flushing IO for device /dev/sdd {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c46805-3cf2-4ae0-9324-ec6f075ef97d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f5ea66-9595-461a-85db-6adcf9f3aed7]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe154f1-df8a-4ee5-8da1-1a4333cc1ad0]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3ca761-8aeb-4ace-abfe-fcf964311424]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af, portal: 172.16.0.220,3260]
Nov 16 00:47:27 user nova-compute[75826]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af, portal: 172.16.0.220,3260] successful.
Nov 16 00:47:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee88b9a8-9850-4bfe-bc3b-7b9bca0bb1fe]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] <== disconnect_volume: return (333ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG nova.objects.instance [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lazy-loading 'flavor' on Instance uuid 5be68126-c125-441d-8f82-4c474b7ce768 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3be8cad8-28dd-4d60-9ab0-2142f5af1b26 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5be68126-c125-441d-8f82-4c474b7ce768" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.672s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5be68126-c125-441d-8f82-4c474b7ce768" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.556s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:27 user nova-compute[75826]: INFO nova.compute.manager [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Terminating instance
Nov 16 00:47:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:47:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG nova.compute.manager [req-aa04848e-6988-449b-a41b-9107b7565cd8 req-a7cb34e5-94eb-477b-bca2-bf7ef4649d0e service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received event network-vif-unplugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-aa04848e-6988-449b-a41b-9107b7565cd8 req-a7cb34e5-94eb-477b-bca2-bf7ef4649d0e service nova] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-aa04848e-6988-449b-a41b-9107b7565cd8 req-a7cb34e5-94eb-477b-bca2-bf7ef4649d0e service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-aa04848e-6988-449b-a41b-9107b7565cd8 req-a7cb34e5-94eb-477b-bca2-bf7ef4649d0e service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG nova.compute.manager [req-aa04848e-6988-449b-a41b-9107b7565cd8 req-a7cb34e5-94eb-477b-bca2-bf7ef4649d0e service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] No waiting events found dispatching network-vif-unplugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG nova.compute.manager [req-aa04848e-6988-449b-a41b-9107b7565cd8 req-a7cb34e5-94eb-477b-bca2-bf7ef4649d0e service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received event network-vif-unplugged-bfa57e78-a3df-44e1-9268-e37a5d006931 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Instance destroyed successfully.
Nov 16 00:47:28 user nova-compute[75826]: DEBUG nova.objects.instance [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lazy-loading 'resources' on Instance uuid 5be68126-c125-441d-8f82-4c474b7ce768 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:44:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-240075061',display_name='tempest-VolumesSnapshotTestJSON-instance-240075061',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-240075061',id=22,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQe1Ki3X9ZchL/WXY0JGe/bgwWt2WwFqCr3DF0WYj7QWSm5uAYqsrQmYmnkbpKHdghMtjLeKyVHdpaZRbTAvFnH808h7vkO6JxmV32R5PXU4sxrQahpyJcMQKFnBF5odw==',key_name='tempest-keypair-761531832',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:44:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d6b9da552fd49509a93b461cceb15ad',ramdisk_id='',reservation_id='r-frxgt8to',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1407250662',owner_user_name='tempest-VolumesSnapshotTestJSON-1407250662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:44:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca3f8ab341484fc6ae7176cd66e18e7b',uuid=5be68126-c125-441d-8f82-4c474b7ce768,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfa57e78-a3df-44e1-9268-e37a5d006931", "address": "fa:16:3e:d9:35:e0", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa57e78-a3", "ovs_interfaceid": "bfa57e78-a3df-44e1-9268-e37a5d006931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Converting VIF {"id": "bfa57e78-a3df-44e1-9268-e37a5d006931", "address": "fa:16:3e:d9:35:e0", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfa57e78-a3", "ovs_interfaceid": "bfa57e78-a3df-44e1-9268-e37a5d006931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:35:e0,bridge_name='br-int',has_traffic_filtering=True,id=bfa57e78-a3df-44e1-9268-e37a5d006931,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa57e78-a3') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG os_vif [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:35:e0,bridge_name='br-int',has_traffic_filtering=True,id=bfa57e78-a3df-44e1-9268-e37a5d006931,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa57e78-a3') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfa57e78-a3, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d274680-1a64-438a-9bbb-163498142d15) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: INFO os_vif [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:35:e0,bridge_name='br-int',has_traffic_filtering=True,id=bfa57e78-a3df-44e1-9268-e37a5d006931,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfa57e78-a3')
Nov 16 00:47:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OIwQEzMN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:47:28 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:47:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17c3089-3eed-4e29-937c-f4c6a5167e6d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:47:28 user nova-compute[75826]: No targets found.
Nov 16 00:47:28 user nova-compute[75826]: iSNS:
Nov 16 00:47:28 user nova-compute[75826]: No targets found.
Nov 16 00:47:28 user nova-compute[75826]: STATIC:
Nov 16 00:47:28 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:47:28 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:28 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:28 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:47:28 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:28 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:28 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:47:28 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:28 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:28 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:47:28 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:28 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:28 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:47:28 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:28 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:28 user nova-compute[75826]: FIRMWARE:
Nov 16 00:47:28 user nova-compute[75826]: No targets found.
Nov 16 00:47:28 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:47:28 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:47:28 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f36b8f0-2961-421f-ad43-26c0475620af', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba8ea03-fbb3-48f4-bf23-57bbd3e82a65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[441bd6bb-70ce-48df-83ee-3d6d82ab6c97]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:28 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:28 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:28 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:28 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:47:28 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:28 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:28 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:28 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:28 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:47:28 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd946f3880>, {}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Disconnecting from: [] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.110s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] <== disconnect_volume: return (111ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:47:28 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Deleting instance files /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768_del
Nov 16 00:47:28 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Deletion of /opt/stack/data/nova/instances/5be68126-c125-441d-8f82-4c474b7ce768_del complete
Nov 16 00:47:28 user nova-compute[75826]: INFO nova.compute.manager [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 16 00:47:28 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:47:28 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:47:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:29 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:29 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Took 0.80 seconds to deallocate network for instance.
Nov 16 00:47:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-039be809-5e7d-4500-8dd6-214d17d90327 req-9a0f61d3-647f-4761-bc94-65516fb9619a service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received event network-vif-deleted-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:29 user nova-compute[75826]: INFO nova.compute.manager [req-039be809-5e7d-4500-8dd6-214d17d90327 req-9a0f61d3-647f-4761-bc94-65516fb9619a service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Neutron deleted interface bfa57e78-a3df-44e1-9268-e37a5d006931; detaching it from the instance and deleting it from the info cache
Nov 16 00:47:29 user nova-compute[75826]: DEBUG nova.network.neutron [req-039be809-5e7d-4500-8dd6-214d17d90327 req-9a0f61d3-647f-4761-bc94-65516fb9619a service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:29 user nova-compute[75826]: WARNING nova.volume.cinder [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Attachment 74be69cd-52ac-499f-a7f1-7c595fb67828 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 74be69cd-52ac-499f-a7f1-7c595fb67828. (HTTP 404) (Request-ID: req-14fd6846-e0c5-45a7-a666-8921c4e129e7)
Nov 16 00:47:29 user nova-compute[75826]: INFO nova.compute.manager [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Took 0.03 seconds to detach 1 volumes for instance.
Nov 16 00:47:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-039be809-5e7d-4500-8dd6-214d17d90327 req-9a0f61d3-647f-4761-bc94-65516fb9619a service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Detach interface failed, port_id=bfa57e78-a3df-44e1-9268-e37a5d006931, reason: Instance 5be68126-c125-441d-8f82-4c474b7ce768 could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:47:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received event network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] No waiting events found dispatching network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:30 user nova-compute[75826]: WARNING nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received unexpected event network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 for instance with vm_state deleted and task_state None.
Nov 16 00:47:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received event network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] No waiting events found dispatching network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:30 user nova-compute[75826]: WARNING nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received unexpected event network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 for instance with vm_state deleted and task_state None.
Nov 16 00:47:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received event network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] No waiting events found dispatching network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:30 user nova-compute[75826]: WARNING nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received unexpected event network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 for instance with vm_state deleted and task_state None.
Nov 16 00:47:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received event network-vif-unplugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] No waiting events found dispatching network-vif-unplugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:30 user nova-compute[75826]: WARNING nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received unexpected event network-vif-unplugged-bfa57e78-a3df-44e1-9268-e37a5d006931 for instance with vm_state deleted and task_state None.
Nov 16 00:47:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received event network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Acquiring lock "5be68126-c125-441d-8f82-4c474b7ce768-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] Lock "5be68126-c125-441d-8f82-4c474b7ce768-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] No waiting events found dispatching network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:30 user nova-compute[75826]: WARNING nova.compute.manager [req-097f8b16-2b04-4840-a600-711a29c574c7 req-a473c737-8903-4b81-ad18-c16fc6e21a6b service nova] [instance: 5be68126-c125-441d-8f82-4c474b7ce768] Received unexpected event network-vif-plugged-bfa57e78-a3df-44e1-9268-e37a5d006931 for instance with vm_state deleted and task_state None.
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.404s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:30 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Deleted allocations for instance 5be68126-c125-441d-8f82-4c474b7ce768
Nov 16 00:47:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1c5b7b8e-9e10-464c-ab7a-d34dc8c5292d tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5be68126-c125-441d-8f82-4c474b7ce768" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.438s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:38 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:47:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:47:38 user nova-compute[75826]: INFO nova.compute.claims [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Claim successful on node user
Nov 16 00:47:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:47:39 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:47:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG nova.policy [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8606321461c403cbec7f0a36e454bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c7fd936b74e109f83fc69060af216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:47:39 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Creating image(s)
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "/opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "/opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "/opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.220s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.220s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk 1073741824" returned: 0 in 0.058s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Successfully created port: 80c45b41-fa0d-48f6-8006-367e6c52e6d1 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.205s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Cannot resize image /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Ensure instance console log exists: /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-d5c8e315-2ca1-4adb-941b-b16c948dd210 req-0b3478e3-e85a-4735-953d-fcce6e3460ed service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Received event network-changed-236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-d5c8e315-2ca1-4adb-941b-b16c948dd210 req-0b3478e3-e85a-4735-953d-fcce6e3460ed service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Refreshing instance network info cache due to event network-changed-236b01b5-75c3-44de-9672-6fc73939c4a0. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d5c8e315-2ca1-4adb-941b-b16c948dd210 req-0b3478e3-e85a-4735-953d-fcce6e3460ed service nova] Acquiring lock "refresh_cache-1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d5c8e315-2ca1-4adb-941b-b16c948dd210 req-0b3478e3-e85a-4735-953d-fcce6e3460ed service nova] Acquired lock "refresh_cache-1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG nova.network.neutron [req-d5c8e315-2ca1-4adb-941b-b16c948dd210 req-0b3478e3-e85a-4735-953d-fcce6e3460ed service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Refreshing network info cache for port 236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:40 user nova-compute[75826]: INFO nova.compute.manager [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Terminating instance
Nov 16 00:47:40 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:41 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Instance destroyed successfully.
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.objects.instance [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lazy-loading 'resources' on Instance uuid 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:40:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1624888409',display_name='tempest-TestStampPattern-server-1624888409',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1624888409',id=12,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMnVOKXX9r1n1SeXR18FAZ5ReiXMg6r0YfIpLL5KrVybqfFaIfm7SGvy2MKiB0irAegI0W1yk67LwVXLx0F4yvrQoFAmD1fY1rcoS5KnlcevqtmC0fE4TYt7AS0e05sCcw==',key_name='tempest-TestStampPattern-2032325257',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='151c8475c39a472b9f99d7b94752e148',ramdisk_id='',reservation_id='r-ezr44zjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1037297845',owner_user_name='tempest-TestStampPattern-1037297845-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:43:47Z,user_data=None,user_id='5562a4fee0d14187bcb346ba5a4634af',uuid=1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "236b01b5-75c3-44de-9672-6fc73939c4a0", "address": "fa:16:3e:b4:52:8d", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236b01b5-75", "ovs_interfaceid": "236b01b5-75c3-44de-9672-6fc73939c4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Converting VIF {"id": "236b01b5-75c3-44de-9672-6fc73939c4a0", "address": "fa:16:3e:b4:52:8d", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.91", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236b01b5-75", "ovs_interfaceid": "236b01b5-75c3-44de-9672-6fc73939c4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=236b01b5-75c3-44de-9672-6fc73939c4a0,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236b01b5-75') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG os_vif [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=236b01b5-75c3-44de-9672-6fc73939c4a0,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236b01b5-75') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap236b01b5-75, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a51f223e-8ce2-4dc9-bd6e-967da9cbe945) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:41 user nova-compute[75826]: INFO os_vif [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:52:8d,bridge_name='br-int',has_traffic_filtering=True,id=236b01b5-75c3-44de-9672-6fc73939c4a0,network=Network(7e79b698-1dbc-447a-a7b3-dbdf1276a1dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap236b01b5-75')
Nov 16 00:47:41 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Deleting instance files /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25_del
Nov 16 00:47:41 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Deletion of /opt/stack/data/nova/instances/1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25_del complete
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-d5c8e315-2ca1-4adb-941b-b16c948dd210 req-0b3478e3-e85a-4735-953d-fcce6e3460ed service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Updated VIF entry in instance network info cache for port 236b01b5-75c3-44de-9672-6fc73939c4a0. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-d5c8e315-2ca1-4adb-941b-b16c948dd210 req-0b3478e3-e85a-4735-953d-fcce6e3460ed service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Updating instance_info_cache with network_info: [{"id": "236b01b5-75c3-44de-9672-6fc73939c4a0", "address": "fa:16:3e:b4:52:8d", "network": {"id": "7e79b698-1dbc-447a-a7b3-dbdf1276a1dc", "bridge": "br-int", "label": "tempest-TestStampPattern-1222576190-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "151c8475c39a472b9f99d7b94752e148", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap236b01b5-75", "ovs_interfaceid": "236b01b5-75c3-44de-9672-6fc73939c4a0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d5c8e315-2ca1-4adb-941b-b16c948dd210 req-0b3478e3-e85a-4735-953d-fcce6e3460ed service nova] Releasing lock "refresh_cache-1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Successfully updated port: 80c45b41-fa0d-48f6-8006-367e6c52e6d1 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "refresh_cache-87b2703e-0154-445e-b659-5f5cf1d9f8f4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquired lock "refresh_cache-87b2703e-0154-445e-b659-5f5cf1d9f8f4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:47:41 user nova-compute[75826]: INFO nova.compute.manager [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 00:47:41 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-0d60172f-1339-45d5-a95e-d5bf1fce1525 req-4244b2e8-5a40-450a-903a-bc51707c6e2a service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Received event network-changed-80c45b41-fa0d-48f6-8006-367e6c52e6d1 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-0d60172f-1339-45d5-a95e-d5bf1fce1525 req-4244b2e8-5a40-450a-903a-bc51707c6e2a service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Refreshing instance network info cache due to event network-changed-80c45b41-fa0d-48f6-8006-367e6c52e6d1. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0d60172f-1339-45d5-a95e-d5bf1fce1525 req-4244b2e8-5a40-450a-903a-bc51707c6e2a service nova] Acquiring lock "refresh_cache-87b2703e-0154-445e-b659-5f5cf1d9f8f4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "7c67f025-987e-435c-b1d9-7936832fe72b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:41 user nova-compute[75826]: INFO nova.compute.manager [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Terminating instance
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Updating instance_info_cache with network_info: [{"id": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "address": "fa:16:3e:96:e6:37", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c45b41-fa", "ovs_interfaceid": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Releasing lock "refresh_cache-87b2703e-0154-445e-b659-5f5cf1d9f8f4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Instance network_info: |[{"id": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "address": "fa:16:3e:96:e6:37", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c45b41-fa", "ovs_interfaceid": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0d60172f-1339-45d5-a95e-d5bf1fce1525 req-4244b2e8-5a40-450a-903a-bc51707c6e2a service nova] Acquired lock "refresh_cache-87b2703e-0154-445e-b659-5f5cf1d9f8f4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-0d60172f-1339-45d5-a95e-d5bf1fce1525 req-4244b2e8-5a40-450a-903a-bc51707c6e2a service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Refreshing network info cache for port 80c45b41-fa0d-48f6-8006-367e6c52e6d1 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Start _get_guest_xml network_info=[{"id": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "address": "fa:16:3e:96:e6:37", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c45b41-fa", "ovs_interfaceid": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:47:41 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:47:41 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:47:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-597028634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-597028634',id=24,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-b56xfuh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:47:39Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=87b2703e-0154-445e-b659-5f5cf1d9f8f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "address": "fa:16:3e:96:e6:37", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c45b41-fa", "ovs_interfaceid": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "address": "fa:16:3e:96:e6:37", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c45b41-fa", "ovs_interfaceid": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=80c45b41-fa0d-48f6-8006-367e6c52e6d1,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c45b41-fa') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.objects.instance [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'pci_devices' on Instance uuid 87b2703e-0154-445e-b659-5f5cf1d9f8f4 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:47:42 user nova-compute[75826]:   <uuid>87b2703e-0154-445e-b659-5f5cf1d9f8f4</uuid>
Nov 16 00:47:42 user nova-compute[75826]:   <name>instance-00000018</name>
Nov 16 00:47:42 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:47:42 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:47:42 user nova-compute[75826]:   <metadata>
Nov 16 00:47:42 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:47:42 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:47:42 user nova-compute[75826]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-597028634</nova:name>
Nov 16 00:47:42 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:47:41</nova:creationTime>
Nov 16 00:47:42 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:47:42 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:47:42 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:47:42 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:47:42 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:47:42 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:47:42 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:47:42 user nova-compute[75826]:       <nova:owner>
Nov 16 00:47:42 user nova-compute[75826]:         <nova:user uuid="f8606321461c403cbec7f0a36e454bc8">tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member</nova:user>
Nov 16 00:47:42 user nova-compute[75826]:         <nova:project uuid="e45c7fd936b74e109f83fc69060af216">tempest-ServerBootFromVolumeStableRescueTest-1116494461</nova:project>
Nov 16 00:47:42 user nova-compute[75826]:       </nova:owner>
Nov 16 00:47:42 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:47:42 user nova-compute[75826]:       <nova:ports>
Nov 16 00:47:42 user nova-compute[75826]:         <nova:port uuid="80c45b41-fa0d-48f6-8006-367e6c52e6d1">
Nov 16 00:47:42 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 00:47:42 user nova-compute[75826]:         </nova:port>
Nov 16 00:47:42 user nova-compute[75826]:       </nova:ports>
Nov 16 00:47:42 user nova-compute[75826]:     </nova:instance>
Nov 16 00:47:42 user nova-compute[75826]:   </metadata>
Nov 16 00:47:42 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:47:42 user nova-compute[75826]:     <system>
Nov 16 00:47:42 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:47:42 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:47:42 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:47:42 user nova-compute[75826]:       <entry name="serial">87b2703e-0154-445e-b659-5f5cf1d9f8f4</entry>
Nov 16 00:47:42 user nova-compute[75826]:       <entry name="uuid">87b2703e-0154-445e-b659-5f5cf1d9f8f4</entry>
Nov 16 00:47:42 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:47:42 user nova-compute[75826]:     </system>
Nov 16 00:47:42 user nova-compute[75826]:   </sysinfo>
Nov 16 00:47:42 user nova-compute[75826]:   <os>
Nov 16 00:47:42 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:47:42 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:47:42 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:47:42 user nova-compute[75826]:   </os>
Nov 16 00:47:42 user nova-compute[75826]:   <features>
Nov 16 00:47:42 user nova-compute[75826]:     <acpi/>
Nov 16 00:47:42 user nova-compute[75826]:     <apic/>
Nov 16 00:47:42 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:47:42 user nova-compute[75826]:   </features>
Nov 16 00:47:42 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:47:42 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:47:42 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:47:42 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:47:42 user nova-compute[75826]:   </clock>
Nov 16 00:47:42 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:47:42 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:47:42 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:47:42 user nova-compute[75826]:   </cpu>
Nov 16 00:47:42 user nova-compute[75826]:   <devices>
Nov 16 00:47:42 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:47:42 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:47:42 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk"/>
Nov 16 00:47:42 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:47:42 user nova-compute[75826]:     </disk>
Nov 16 00:47:42 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:47:42 user nova-compute[75826]:       <mac address="fa:16:3e:96:e6:37"/>
Nov 16 00:47:42 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:47:42 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:47:42 user nova-compute[75826]:       <target dev="tap80c45b41-fa"/>
Nov 16 00:47:42 user nova-compute[75826]:     </interface>
Nov 16 00:47:42 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:47:42 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/console.log" append="off"/>
Nov 16 00:47:42 user nova-compute[75826]:     </serial>
Nov 16 00:47:42 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:47:42 user nova-compute[75826]:     <video>
Nov 16 00:47:42 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:47:42 user nova-compute[75826]:     </video>
Nov 16 00:47:42 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:47:42 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:47:42 user nova-compute[75826]:     </rng>
Nov 16 00:47:42 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:47:42 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:47:42 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:47:42 user nova-compute[75826]:     </memballoon>
Nov 16 00:47:42 user nova-compute[75826]:   </devices>
Nov 16 00:47:42 user nova-compute[75826]: </domain>
Nov 16 00:47:42 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-597028634',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-597028634',id=24,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-b56xfuh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:47:39Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=87b2703e-0154-445e-b659-5f5cf1d9f8f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "address": "fa:16:3e:96:e6:37", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c45b41-fa", "ovs_interfaceid": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "address": "fa:16:3e:96:e6:37", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c45b41-fa", "ovs_interfaceid": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=80c45b41-fa0d-48f6-8006-367e6c52e6d1,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c45b41-fa') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG os_vif [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=80c45b41-fa0d-48f6-8006-367e6c52e6d1,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c45b41-fa') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c5d2f9f-b562-5f86-96ad-868a6d0d6ed5', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80c45b41-fa, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80c45b41-fa, col_values=(('qos', UUID('80cba40a-4c0a-42ef-b561-774a81e68768')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80c45b41-fa, col_values=(('external_ids', {'iface-id': '80c45b41-fa0d-48f6-8006-367e6c52e6d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:e6:37', 'vm-uuid': '87b2703e-0154-445e-b659-5f5cf1d9f8f4'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:42 user nova-compute[75826]: INFO os_vif [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=80c45b41-fa0d-48f6-8006-367e6c52e6d1,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c45b41-fa')
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:42 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Took 0.88 seconds to deallocate network for instance.
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No VIF found with MAC fa:16:3e:96:e6:37, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:47:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Instance destroyed successfully.
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.objects.instance [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lazy-loading 'resources' on Instance uuid 7c67f025-987e-435c-b1d9-7936832fe72b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:44:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-817836755',display_name='tempest-TestVolumeSwap-server-817836755',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-817836755',id=19,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7moLRH490xIbcJvcFk95rGBPLvXKk9uLJ3cySWPbIOgapbJepJip/nbQo1QkoAt4sFKeHE2SOh0fciQ/T3YqSKeTJ0Is6r40FkTAy/qhVdqhZLf5/JErPLemXGOgRzPQ==',key_name='tempest-keypair-1781236172',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:44:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='288f933627b44a62b64e093c6a57d6a7',ramdisk_id='',reservation_id='r-fq8oghmb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-832049961',owner_user_name='tempest-TestVolumeSwap-832049961-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4db0919906cd443d893ab4b884d5f454',uuid=7c67f025-987e-435c-b1d9-7936832fe72b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "address": "fa:16:3e:5c:fa:48", "network": {"id": "536b4ba3-0a32-4ae8-b94b-f095d82c8d9e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1917941408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "288f933627b44a62b64e093c6a57d6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5701d2a-63", "ovs_interfaceid": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Converting VIF {"id": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "address": "fa:16:3e:5c:fa:48", "network": {"id": "536b4ba3-0a32-4ae8-b94b-f095d82c8d9e", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1917941408-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "288f933627b44a62b64e093c6a57d6a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb5701d2a-63", "ovs_interfaceid": "b5701d2a-63a8-4968-bec1-7aa295b81b60", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:fa:48,bridge_name='br-int',has_traffic_filtering=True,id=b5701d2a-63a8-4968-bec1-7aa295b81b60,network=Network(536b4ba3-0a32-4ae8-b94b-f095d82c8d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5701d2a-63') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG os_vif [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:fa:48,bridge_name='br-int',has_traffic_filtering=True,id=b5701d2a-63a8-4968-bec1-7aa295b81b60,network=Network(536b4ba3-0a32-4ae8-b94b-f095d82c8d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5701d2a-63') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb5701d2a-63, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e6570e5-40d5-4d34-ac1c-1bfa0197d5bc) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:42 user nova-compute[75826]: INFO os_vif [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:fa:48,bridge_name='br-int',has_traffic_filtering=True,id=b5701d2a-63a8-4968-bec1-7aa295b81b60,network=Network(536b4ba3-0a32-4ae8-b94b-f095d82c8d9e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb5701d2a-63')
Nov 16 00:47:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Deleting instance files /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b_del
Nov 16 00:47:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Deletion of /opt/stack/data/nova/instances/7c67f025-987e-435c-b1d9-7936832fe72b_del complete
Nov 16 00:47:42 user nova-compute[75826]: INFO nova.compute.manager [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Received event network-vif-unplugged-236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] Acquiring lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] No waiting events found dispatching network-vif-unplugged-236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:42 user nova-compute[75826]: WARNING nova.compute.manager [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Received unexpected event network-vif-unplugged-236b01b5-75c3-44de-9672-6fc73939c4a0 for instance with vm_state deleted and task_state None.
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Received event network-vif-plugged-236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] Acquiring lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] No waiting events found dispatching network-vif-plugged-236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:42 user nova-compute[75826]: WARNING nova.compute.manager [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Received unexpected event network-vif-plugged-236b01b5-75c3-44de-9672-6fc73939c4a0 for instance with vm_state deleted and task_state None.
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Received event network-vif-unplugged-b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] Acquiring lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] Lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] Lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] No waiting events found dispatching network-vif-unplugged-b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Received event network-vif-unplugged-b5701d2a-63a8-4968-bec1-7aa295b81b60 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Received event network-vif-plugged-b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] Acquiring lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] Lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] Lock "7c67f025-987e-435c-b1d9-7936832fe72b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] No waiting events found dispatching network-vif-plugged-b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:42 user nova-compute[75826]: WARNING nova.compute.manager [req-69095af8-13c8-40c2-978f-119c1a5c5d1b req-68387c66-91c1-4e20-b94e-fea08a1a74fa service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Received unexpected event network-vif-plugged-b5701d2a-63a8-4968-bec1-7aa295b81b60 for instance with vm_state active and task_state deleting.
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.network.neutron [req-0d60172f-1339-45d5-a95e-d5bf1fce1525 req-4244b2e8-5a40-450a-903a-bc51707c6e2a service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Updated VIF entry in instance network info cache for port 80c45b41-fa0d-48f6-8006-367e6c52e6d1. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.network.neutron [req-0d60172f-1339-45d5-a95e-d5bf1fce1525 req-4244b2e8-5a40-450a-903a-bc51707c6e2a service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Updating instance_info_cache with network_info: [{"id": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "address": "fa:16:3e:96:e6:37", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c45b41-fa", "ovs_interfaceid": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0d60172f-1339-45d5-a95e-d5bf1fce1525 req-4244b2e8-5a40-450a-903a-bc51707c6e2a service nova] Releasing lock "refresh_cache-87b2703e-0154-445e-b659-5f5cf1d9f8f4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:42 user nova-compute[75826]: INFO nova.compute.manager [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Detaching volume 88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:47:42 user nova-compute[75826]: INFO nova.virt.block_device [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Attempting to driver detach volume 88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 from mountpoint /dev/vdb
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Attempting to detach device vdb from instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:47:42 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:47:42 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 00:47:42 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:47:42 user nova-compute[75826]:   <serial>88fa2ef5-c0dd-4acb-8376-9e74e9e0c087</serial>
Nov 16 00:47:42 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 00:47:42 user nova-compute[75826]: </disk>
Nov 16 00:47:42 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.497s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Successfully detached device vdb from instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 from the persistent domain config.
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:47:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:47:42 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:47:42 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 00:47:42 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:47:42 user nova-compute[75826]:   <serial>88fa2ef5-c0dd-4acb-8376-9e74e9e0c087</serial>
Nov 16 00:47:42 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 00:47:42 user nova-compute[75826]: </disk>
Nov 16 00:47:42 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:47:42 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Deleted allocations for instance 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25
Nov 16 00:47:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7850a315-03cb-4834-aa3e-5ef68b8552c8 tempest-TestStampPattern-1037297845 tempest-TestStampPattern-1037297845-project-member] Lock "1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.440s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:43 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:43 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Took 0.92 seconds to deallocate network for instance.
Nov 16 00:47:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:47:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-0ce00bce-0b48-4542-8b2b-a5aadda5334e req-21c3c2f0-caaf-4a4f-a7d5-893a681d4844 service nova] [instance: 1a4e2435-67a1-4e05-a3a7-2d0c8dc6ca25] Received event network-vif-deleted-236b01b5-75c3-44de-9672-6fc73939c4a0 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-0ce00bce-0b48-4542-8b2b-a5aadda5334e req-21c3c2f0-caaf-4a4f-a7d5-893a681d4844 service nova] [instance: 7c67f025-987e-435c-b1d9-7936832fe72b] Received event network-vif-deleted-b5701d2a-63a8-4968-bec1-7aa295b81b60 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:43 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:47:43 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:47:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:43 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Deleted allocations for instance 7c67f025-987e-435c-b1d9-7936832fe72b
Nov 16 00:47:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9d4e52f0-6083-479b-b2d8-54d192cfad0c tempest-TestVolumeSwap-832049961 tempest-TestVolumeSwap-832049961-project-member] Lock "7c67f025-987e-435c-b1d9-7936832fe72b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.434s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-e580f115-cf06-4c55-a5e1-9d1f892a27ae req-f3d9c5e3-542f-4091-ae19-8f6939df1571 service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Received event network-vif-plugged-80c45b41-fa0d-48f6-8006-367e6c52e6d1 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e580f115-cf06-4c55-a5e1-9d1f892a27ae req-f3d9c5e3-542f-4091-ae19-8f6939df1571 service nova] Acquiring lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e580f115-cf06-4c55-a5e1-9d1f892a27ae req-f3d9c5e3-542f-4091-ae19-8f6939df1571 service nova] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e580f115-cf06-4c55-a5e1-9d1f892a27ae req-f3d9c5e3-542f-4091-ae19-8f6939df1571 service nova] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-e580f115-cf06-4c55-a5e1-9d1f892a27ae req-f3d9c5e3-542f-4091-ae19-8f6939df1571 service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] No waiting events found dispatching network-vif-plugged-80c45b41-fa0d-48f6-8006-367e6c52e6d1 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:44 user nova-compute[75826]: WARNING nova.compute.manager [req-e580f115-cf06-4c55-a5e1-9d1f892a27ae req-f3d9c5e3-542f-4091-ae19-8f6939df1571 service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Received unexpected event network-vif-plugged-80c45b41-fa0d-48f6-8006-367e6c52e6d1 for instance with vm_state building and task_state spawning.
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:46 user nova-compute[75826]: INFO nova.compute.manager [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Terminating instance
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:47:46 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Instance spawned successfully.
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:47:46 user nova-compute[75826]: INFO nova.compute.manager [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Took 7.11 seconds to spawn the instance on the hypervisor.
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-955a2fe4-7c1b-4bd2-bed9-19334b4f93ef req-d04dcabd-6699-4dc4-b111-5c3d371d3df3 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-unplugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-955a2fe4-7c1b-4bd2-bed9-19334b4f93ef req-d04dcabd-6699-4dc4-b111-5c3d371d3df3 service nova] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-955a2fe4-7c1b-4bd2-bed9-19334b4f93ef req-d04dcabd-6699-4dc4-b111-5c3d371d3df3 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-955a2fe4-7c1b-4bd2-bed9-19334b4f93ef req-d04dcabd-6699-4dc4-b111-5c3d371d3df3 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-955a2fe4-7c1b-4bd2-bed9-19334b4f93ef req-d04dcabd-6699-4dc4-b111-5c3d371d3df3 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] No waiting events found dispatching network-vif-unplugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-955a2fe4-7c1b-4bd2-bed9-19334b4f93ef req-d04dcabd-6699-4dc4-b111-5c3d371d3df3 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-unplugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-c5a7307d-9559-42e1-afe6-e3287ec9a430 req-c9627836-6c8a-4dfb-8a1a-92798a0c4c8e service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Received event network-vif-plugged-80c45b41-fa0d-48f6-8006-367e6c52e6d1 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c5a7307d-9559-42e1-afe6-e3287ec9a430 req-c9627836-6c8a-4dfb-8a1a-92798a0c4c8e service nova] Acquiring lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c5a7307d-9559-42e1-afe6-e3287ec9a430 req-c9627836-6c8a-4dfb-8a1a-92798a0c4c8e service nova] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c5a7307d-9559-42e1-afe6-e3287ec9a430 req-c9627836-6c8a-4dfb-8a1a-92798a0c4c8e service nova] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-c5a7307d-9559-42e1-afe6-e3287ec9a430 req-c9627836-6c8a-4dfb-8a1a-92798a0c4c8e service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] No waiting events found dispatching network-vif-plugged-80c45b41-fa0d-48f6-8006-367e6c52e6d1 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:46 user nova-compute[75826]: WARNING nova.compute.manager [req-c5a7307d-9559-42e1-afe6-e3287ec9a430 req-c9627836-6c8a-4dfb-8a1a-92798a0c4c8e service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Received unexpected event network-vif-plugged-80c45b41-fa0d-48f6-8006-367e6c52e6d1 for instance with vm_state building and task_state spawning.
Nov 16 00:47:46 user nova-compute[75826]: INFO nova.compute.manager [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Took 8.04 seconds to build instance.
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2e00244e-e3ac-477c-b4c0-23e7d989fc03 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.147s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:46 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Instance destroyed successfully.
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.objects.instance [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lazy-loading 'resources' on Instance uuid 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-128052432',display_name='tempest-ServerActionsTestOtherB-server-128052432',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-128052432',id=4,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMXVSxyrOOv945LMuSP1ZSY2bKy/r2ENoqaOk1WP30X55vRshqh2IlMTn2ZQNXytP2IoxEzIDq41/VjnE1Be/JLQH8UoBKnsMheiLtYOBuEJV23nUuMbFcWJ5C5rYTqIuQ==',key_name='tempest-keypair-103688613',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:45:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='150aa3cf14d44a658edb06ade47a2d10',ramdisk_id='',reservation_id='r-tzkzh647',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1007762654',owner_user_name='tempest-ServerActionsTestOtherB-1007762654-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:45:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='19886e0e1844467785425d17411f9656',uuid=713e6618-89af-47e0-ba5a-4f77cb1d7ff6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converting VIF {"id": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "address": "fa:16:3e:be:0d:c1", "network": {"id": "c992ac26-63ed-4086-99ba-1701d8ed3859", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-973270379-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "150aa3cf14d44a658edb06ade47a2d10", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cb43f66-87", "ovs_interfaceid": "7cb43f66-87cf-4cac-85ab-abfe01ff82cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG os_vif [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cb43f66-87, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=45860139-431a-45da-a004-453937cb62f5) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:46 user nova-compute[75826]: INFO os_vif [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:be:0d:c1,bridge_name='br-int',has_traffic_filtering=True,id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc,network=Network(c992ac26-63ed-4086-99ba-1701d8ed3859),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cb43f66-87')
Nov 16 00:47:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CEVTKsux', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:47:46 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:47:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5c64d0-28a4-4a6a-b581-4b612deb6147]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:47:46 user nova-compute[75826]: No targets found.
Nov 16 00:47:46 user nova-compute[75826]: iSNS:
Nov 16 00:47:46 user nova-compute[75826]: No targets found.
Nov 16 00:47:46 user nova-compute[75826]: STATIC:
Nov 16 00:47:46 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18
Nov 16 00:47:46 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:46 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:46 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:47:46 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:46 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:46 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:47:46 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:46 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:46 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:47:46 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:46 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:46 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:47:46 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:47:46 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:47:46 user nova-compute[75826]: FIRMWARE:
Nov 16 00:47:46 user nova-compute[75826]: No targets found.
Nov 16 00:47:46 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:47:46 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:47:46 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2983d617-d558-4a33-be46-cb3de11769ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1917138c-dc29-4905-a63b-f8dc650ad393]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:47 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:47 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:47 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:47 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:47:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:47:47 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:47:47 user nova-compute[75826]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 (non-flash)
Nov 16 00:47:47 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:47:47 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:47:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd944a04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18'): ({'sdg'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Removing single pathed devices sdg {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6108def4-3e6c-48ca-88dc-802e0f4854ae]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[af68d7a6-f3db-4a15-84d7-b8b8bc87cf08]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Flushing IO for device /dev/sdg {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7cacff-f5c7-46bb-9125-fb6c9927c749]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c4bdb5-c32b-4f05-b9fb-758d352fd0a3]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] SCSI volumes sdg have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be3fa57-a11d-4f8b-9099-3044f7e8aa38]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8547f4f7-3acf-4119-918b-c72e497fcef3]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260]
Nov 16 00:47:47 user nova-compute[75826]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18, portal: 172.16.0.220,3260] successful.
Nov 16 00:47:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48b289f4-4b30-4d11-8683-5419d02afa18 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f7ca42-fd31-44f7-9449-4a10ac42bfdc]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] <== disconnect_volume: return (316ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:47:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Deleting instance files /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6_del
Nov 16 00:47:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Deletion of /opt/stack/data/nova/instances/713e6618-89af-47e0-ba5a-4f77cb1d7ff6_del complete
Nov 16 00:47:47 user nova-compute[75826]: INFO nova.compute.manager [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 16 00:47:47 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:47:47 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:47:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-f2aa9673-46c7-41a1-a265-356330799e6d req-13cd0056-fc3b-4373-8f8a-c39fd07f1ed1 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f2aa9673-46c7-41a1-a265-356330799e6d req-13cd0056-fc3b-4373-8f8a-c39fd07f1ed1 service nova] Acquiring lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f2aa9673-46c7-41a1-a265-356330799e6d req-13cd0056-fc3b-4373-8f8a-c39fd07f1ed1 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f2aa9673-46c7-41a1-a265-356330799e6d req-13cd0056-fc3b-4373-8f8a-c39fd07f1ed1 service nova] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-f2aa9673-46c7-41a1-a265-356330799e6d req-13cd0056-fc3b-4373-8f8a-c39fd07f1ed1 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] No waiting events found dispatching network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:47:48 user nova-compute[75826]: WARNING nova.compute.manager [req-f2aa9673-46c7-41a1-a265-356330799e6d req-13cd0056-fc3b-4373-8f8a-c39fd07f1ed1 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received unexpected event network-vif-plugged-7cb43f66-87cf-4cac-85ab-abfe01ff82cc for instance with vm_state active and task_state deleting.
Nov 16 00:47:48 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-5f0f4519-01d5-47bb-8a3e-8eedf1abf093 req-b4bccf20-b5fb-4eeb-8893-ebe6c59bb118 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Received event network-vif-deleted-7cb43f66-87cf-4cac-85ab-abfe01ff82cc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:48 user nova-compute[75826]: INFO nova.compute.manager [req-5f0f4519-01d5-47bb-8a3e-8eedf1abf093 req-b4bccf20-b5fb-4eeb-8893-ebe6c59bb118 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Neutron deleted interface 7cb43f66-87cf-4cac-85ab-abfe01ff82cc; detaching it from the instance and deleting it from the info cache
Nov 16 00:47:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-5f0f4519-01d5-47bb-8a3e-8eedf1abf093 req-b4bccf20-b5fb-4eeb-8893-ebe6c59bb118 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:48 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Took 1.33 seconds to deallocate network for instance.
Nov 16 00:47:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-5f0f4519-01d5-47bb-8a3e-8eedf1abf093 req-b4bccf20-b5fb-4eeb-8893-ebe6c59bb118 service nova] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Detach interface failed, port_id=7cb43f66-87cf-4cac-85ab-abfe01ff82cc, reason: Instance 713e6618-89af-47e0-ba5a-4f77cb1d7ff6 could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:47:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:49 user nova-compute[75826]: INFO nova.compute.manager [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] [instance: 713e6618-89af-47e0-ba5a-4f77cb1d7ff6] Took 0.89 seconds to detach 1 volumes for instance.
Nov 16 00:47:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:49 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:47:49 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:47:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:49 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Deleted allocations for instance 713e6618-89af-47e0-ba5a-4f77cb1d7ff6
Nov 16 00:47:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ae16cce6-fd12-457a-a64c-15e73186678a tempest-ServerActionsTestOtherB-1007762654 tempest-ServerActionsTestOtherB-1007762654-project-member] Lock "713e6618-89af-47e0-ba5a-4f77cb1d7ff6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.978s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:50 user nova-compute[75826]: INFO nova.compute.manager [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Detaching volume dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:47:50 user nova-compute[75826]: INFO nova.virt.block_device [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Attempting to driver detach volume dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea from mountpoint /dev/vdc
Nov 16 00:47:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Attempting to detach device vdc from instance 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:47:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:47:50 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:47:50 user nova-compute[75826]:   <source dev="/dev/sdi"/>
Nov 16 00:47:50 user nova-compute[75826]:   <target dev="vdc" bus="virtio"/>
Nov 16 00:47:50 user nova-compute[75826]:   <serial>dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea</serial>
Nov 16 00:47:50 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 00:47:50 user nova-compute[75826]: </disk>
Nov 16 00:47:50 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:47:50 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Successfully detached device vdc from instance 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 from the persistent domain config.
Nov 16 00:47:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:47:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:47:50 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:47:50 user nova-compute[75826]:   <source dev="/dev/sdi"/>
Nov 16 00:47:50 user nova-compute[75826]:   <target dev="vdc" bus="virtio"/>
Nov 16 00:47:50 user nova-compute[75826]:   <serial>dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea</serial>
Nov 16 00:47:50 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 00:47:50 user nova-compute[75826]: </disk>
Nov 16 00:47:50 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:47:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:47:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "574817b0-a25c-4da1-9ce6-804008e8279c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:47:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:55 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:47:55 user nova-compute[75826]: INFO nova.compute.claims [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Claim successful on node user
Nov 16 00:47:55 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:47:55 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:47:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.489s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:47:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:47:55 user nova-compute[75826]: DEBUG nova.network.neutron [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:47:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.policy [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '923da525ba264ea4bf770e3a66319655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7dc71f0e2f439f9944bd7410db7e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "7d7971e0-c96d-4690-8a14-033f6dd35776" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:47:56 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Creating image(s)
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "/opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "/opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "/opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:47:56 user nova-compute[75826]: INFO nova.compute.claims [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Claim successful on node user
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk 1073741824" returned: 0 in 0.069s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.network.neutron [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Successfully created port: c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.215s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.network.neutron [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:47:56 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Cannot resize image /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Ensure instance console log exists: /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG nova.policy [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '923da525ba264ea4bf770e3a66319655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7dc71f0e2f439f9944bd7410db7e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:47:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Creating image(s)
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "/opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "/opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.203s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk 1073741824" returned: 0 in 0.055s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG nova.network.neutron [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Successfully updated port: c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquired lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG nova.network.neutron [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-6fee1a46-3ec7-47d3-b3b5-3739d44800f0 req-49f10889-4b2c-4e40-8c8b-f53faf9daa8c service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-changed-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-6fee1a46-3ec7-47d3-b3b5-3739d44800f0 req-49f10889-4b2c-4e40-8c8b-f53faf9daa8c service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Refreshing instance network info cache due to event network-changed-c7936822-0ba8-4241-9e2b-1977e21eba80. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:47:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6fee1a46-3ec7-47d3-b3b5-3739d44800f0 req-49f10889-4b2c-4e40-8c8b-f53faf9daa8c service nova] Acquiring lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Cannot resize image /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Ensure instance console log exists: /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.network.neutron [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.network.neutron [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Successfully created port: f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.network.neutron [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Updating instance_info_cache with network_info: [{"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Releasing lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.compute.manager [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Instance network_info: |[{"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6fee1a46-3ec7-47d3-b3b5-3739d44800f0 req-49f10889-4b2c-4e40-8c8b-f53faf9daa8c service nova] Acquired lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.network.neutron [req-6fee1a46-3ec7-47d3-b3b5-3739d44800f0 req-49f10889-4b2c-4e40-8c8b-f53faf9daa8c service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Refreshing network info cache for port c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Start _get_guest_xml network_info=[{"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:47:58 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:47:58 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:47:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-590900198',display_name='tempest-ServerRescueNegativeTestJSON-server-590900198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-590900198',id=25,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c7dc71f0e2f439f9944bd7410db7e08',ramdisk_id='',reservation_id='r-0dmt5wwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2102246851',owner_user_name='tempest-ServerRescueNegativeTestJSON-2102246851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:47:56Z,user_data=None,user_id='923da525ba264ea4bf770e3a66319655',uuid=574817b0-a25c-4da1-9ce6-804008e8279c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converting VIF {"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:09:38,bridge_name='br-int',has_traffic_filtering=True,id=c7936822-0ba8-4241-9e2b-1977e21eba80,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7936822-0b') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.objects.instance [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'pci_devices' on Instance uuid 574817b0-a25c-4da1-9ce6-804008e8279c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:47:58 user nova-compute[75826]:   <uuid>574817b0-a25c-4da1-9ce6-804008e8279c</uuid>
Nov 16 00:47:58 user nova-compute[75826]:   <name>instance-00000019</name>
Nov 16 00:47:58 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:47:58 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:47:58 user nova-compute[75826]:   <metadata>
Nov 16 00:47:58 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:47:58 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:47:58 user nova-compute[75826]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-590900198</nova:name>
Nov 16 00:47:58 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:47:58</nova:creationTime>
Nov 16 00:47:58 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:47:58 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:47:58 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:47:58 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:47:58 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:47:58 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:47:58 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:47:58 user nova-compute[75826]:       <nova:owner>
Nov 16 00:47:58 user nova-compute[75826]:         <nova:user uuid="923da525ba264ea4bf770e3a66319655">tempest-ServerRescueNegativeTestJSON-2102246851-project-member</nova:user>
Nov 16 00:47:58 user nova-compute[75826]:         <nova:project uuid="5c7dc71f0e2f439f9944bd7410db7e08">tempest-ServerRescueNegativeTestJSON-2102246851</nova:project>
Nov 16 00:47:58 user nova-compute[75826]:       </nova:owner>
Nov 16 00:47:58 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:47:58 user nova-compute[75826]:       <nova:ports>
Nov 16 00:47:58 user nova-compute[75826]:         <nova:port uuid="c7936822-0ba8-4241-9e2b-1977e21eba80">
Nov 16 00:47:58 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 00:47:58 user nova-compute[75826]:         </nova:port>
Nov 16 00:47:58 user nova-compute[75826]:       </nova:ports>
Nov 16 00:47:58 user nova-compute[75826]:     </nova:instance>
Nov 16 00:47:58 user nova-compute[75826]:   </metadata>
Nov 16 00:47:58 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:47:58 user nova-compute[75826]:     <system>
Nov 16 00:47:58 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:47:58 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:47:58 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:47:58 user nova-compute[75826]:       <entry name="serial">574817b0-a25c-4da1-9ce6-804008e8279c</entry>
Nov 16 00:47:58 user nova-compute[75826]:       <entry name="uuid">574817b0-a25c-4da1-9ce6-804008e8279c</entry>
Nov 16 00:47:58 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:47:58 user nova-compute[75826]:     </system>
Nov 16 00:47:58 user nova-compute[75826]:   </sysinfo>
Nov 16 00:47:58 user nova-compute[75826]:   <os>
Nov 16 00:47:58 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:47:58 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:47:58 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:47:58 user nova-compute[75826]:   </os>
Nov 16 00:47:58 user nova-compute[75826]:   <features>
Nov 16 00:47:58 user nova-compute[75826]:     <acpi/>
Nov 16 00:47:58 user nova-compute[75826]:     <apic/>
Nov 16 00:47:58 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:47:58 user nova-compute[75826]:   </features>
Nov 16 00:47:58 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:47:58 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:47:58 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:47:58 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:47:58 user nova-compute[75826]:   </clock>
Nov 16 00:47:58 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:47:58 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:47:58 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:47:58 user nova-compute[75826]:   </cpu>
Nov 16 00:47:58 user nova-compute[75826]:   <devices>
Nov 16 00:47:58 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:47:58 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:47:58 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk"/>
Nov 16 00:47:58 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:47:58 user nova-compute[75826]:     </disk>
Nov 16 00:47:58 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:47:58 user nova-compute[75826]:       <mac address="fa:16:3e:03:09:38"/>
Nov 16 00:47:58 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:47:58 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:47:58 user nova-compute[75826]:       <target dev="tapc7936822-0b"/>
Nov 16 00:47:58 user nova-compute[75826]:     </interface>
Nov 16 00:47:58 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:47:58 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/console.log" append="off"/>
Nov 16 00:47:58 user nova-compute[75826]:     </serial>
Nov 16 00:47:58 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:47:58 user nova-compute[75826]:     <video>
Nov 16 00:47:58 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:47:58 user nova-compute[75826]:     </video>
Nov 16 00:47:58 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:47:58 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:47:58 user nova-compute[75826]:     </rng>
Nov 16 00:47:58 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:47:58 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:47:58 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:47:58 user nova-compute[75826]:     </memballoon>
Nov 16 00:47:58 user nova-compute[75826]:   </devices>
Nov 16 00:47:58 user nova-compute[75826]: </domain>
Nov 16 00:47:58 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:47:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-590900198',display_name='tempest-ServerRescueNegativeTestJSON-server-590900198',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-590900198',id=25,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c7dc71f0e2f439f9944bd7410db7e08',ramdisk_id='',reservation_id='r-0dmt5wwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2102246851',owner_user_name='tempest-ServerRescueNegativeTestJSON-2102246851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:47:56Z,user_data=None,user_id='923da525ba264ea4bf770e3a66319655',uuid=574817b0-a25c-4da1-9ce6-804008e8279c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converting VIF {"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:09:38,bridge_name='br-int',has_traffic_filtering=True,id=c7936822-0ba8-4241-9e2b-1977e21eba80,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7936822-0b') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG os_vif [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:09:38,bridge_name='br-int',has_traffic_filtering=True,id=c7936822-0ba8-4241-9e2b-1977e21eba80,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7936822-0b') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e46fdef-fd4e-58b8-9da3-889bdac1cb00', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7936822-0b, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7936822-0b, col_values=(('qos', UUID('6ece6b8d-6600-466a-8bd6-a09990e68df7')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7936822-0b, col_values=(('external_ids', {'iface-id': 'c7936822-0ba8-4241-9e2b-1977e21eba80', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:09:38', 'vm-uuid': '574817b0-a25c-4da1-9ce6-804008e8279c'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:58 user nova-compute[75826]: INFO os_vif [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:09:38,bridge_name='br-int',has_traffic_filtering=True,id=c7936822-0ba8-4241-9e2b-1977e21eba80,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7936822-0b')
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:47:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No VIF found with MAC fa:16:3e:03:09:38, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.network.neutron [req-6fee1a46-3ec7-47d3-b3b5-3739d44800f0 req-49f10889-4b2c-4e40-8c8b-f53faf9daa8c service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Updated VIF entry in instance network info cache for port c7936822-0ba8-4241-9e2b-1977e21eba80. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.network.neutron [req-6fee1a46-3ec7-47d3-b3b5-3739d44800f0 req-49f10889-4b2c-4e40-8c8b-f53faf9daa8c service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Updating instance_info_cache with network_info: [{"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6fee1a46-3ec7-47d3-b3b5-3739d44800f0 req-49f10889-4b2c-4e40-8c8b-f53faf9daa8c service nova] Releasing lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.network.neutron [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Successfully updated port: f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquired lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.network.neutron [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.network.neutron [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.network.neutron [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Updating instance_info_cache with network_info: [{"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Releasing lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.compute.manager [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Instance network_info: |[{"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Start _get_guest_xml network_info=[{"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:47:59 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:47:59 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:47:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1322313404',display_name='tempest-ServerRescueNegativeTestJSON-server-1322313404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1322313404',id=26,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c7dc71f0e2f439f9944bd7410db7e08',ramdisk_id='',reservation_id='r-40x83n17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2102246851',owner_user_name='tempest-ServerRescueNegativeTestJSON-2102246851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:47:57Z,user_data=None,user_id='923da525ba264ea4bf770e3a66319655',uuid=7d7971e0-c96d-4690-8a14-033f6dd35776,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converting VIF {"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:8f:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5d12fa2-7d94-48c1-a16f-e7330a19ccef,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d12fa2-7d') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.objects.instance [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d7971e0-c96d-4690-8a14-033f6dd35776 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:47:59 user nova-compute[75826]:   <uuid>7d7971e0-c96d-4690-8a14-033f6dd35776</uuid>
Nov 16 00:47:59 user nova-compute[75826]:   <name>instance-0000001a</name>
Nov 16 00:47:59 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:47:59 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:47:59 user nova-compute[75826]:   <metadata>
Nov 16 00:47:59 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:47:59 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:47:59 user nova-compute[75826]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1322313404</nova:name>
Nov 16 00:47:59 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:47:59</nova:creationTime>
Nov 16 00:47:59 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:47:59 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:47:59 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:47:59 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:47:59 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:47:59 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:47:59 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:47:59 user nova-compute[75826]:       <nova:owner>
Nov 16 00:47:59 user nova-compute[75826]:         <nova:user uuid="923da525ba264ea4bf770e3a66319655">tempest-ServerRescueNegativeTestJSON-2102246851-project-member</nova:user>
Nov 16 00:47:59 user nova-compute[75826]:         <nova:project uuid="5c7dc71f0e2f439f9944bd7410db7e08">tempest-ServerRescueNegativeTestJSON-2102246851</nova:project>
Nov 16 00:47:59 user nova-compute[75826]:       </nova:owner>
Nov 16 00:47:59 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:47:59 user nova-compute[75826]:       <nova:ports>
Nov 16 00:47:59 user nova-compute[75826]:         <nova:port uuid="f5d12fa2-7d94-48c1-a16f-e7330a19ccef">
Nov 16 00:47:59 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 00:47:59 user nova-compute[75826]:         </nova:port>
Nov 16 00:47:59 user nova-compute[75826]:       </nova:ports>
Nov 16 00:47:59 user nova-compute[75826]:     </nova:instance>
Nov 16 00:47:59 user nova-compute[75826]:   </metadata>
Nov 16 00:47:59 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:47:59 user nova-compute[75826]:     <system>
Nov 16 00:47:59 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:47:59 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:47:59 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:47:59 user nova-compute[75826]:       <entry name="serial">7d7971e0-c96d-4690-8a14-033f6dd35776</entry>
Nov 16 00:47:59 user nova-compute[75826]:       <entry name="uuid">7d7971e0-c96d-4690-8a14-033f6dd35776</entry>
Nov 16 00:47:59 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:47:59 user nova-compute[75826]:     </system>
Nov 16 00:47:59 user nova-compute[75826]:   </sysinfo>
Nov 16 00:47:59 user nova-compute[75826]:   <os>
Nov 16 00:47:59 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:47:59 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:47:59 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:47:59 user nova-compute[75826]:   </os>
Nov 16 00:47:59 user nova-compute[75826]:   <features>
Nov 16 00:47:59 user nova-compute[75826]:     <acpi/>
Nov 16 00:47:59 user nova-compute[75826]:     <apic/>
Nov 16 00:47:59 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:47:59 user nova-compute[75826]:   </features>
Nov 16 00:47:59 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:47:59 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:47:59 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:47:59 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:47:59 user nova-compute[75826]:   </clock>
Nov 16 00:47:59 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:47:59 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:47:59 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:47:59 user nova-compute[75826]:   </cpu>
Nov 16 00:47:59 user nova-compute[75826]:   <devices>
Nov 16 00:47:59 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:47:59 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:47:59 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk"/>
Nov 16 00:47:59 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:47:59 user nova-compute[75826]:     </disk>
Nov 16 00:47:59 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:47:59 user nova-compute[75826]:       <mac address="fa:16:3e:53:8f:6d"/>
Nov 16 00:47:59 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:47:59 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:47:59 user nova-compute[75826]:       <target dev="tapf5d12fa2-7d"/>
Nov 16 00:47:59 user nova-compute[75826]:     </interface>
Nov 16 00:47:59 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:47:59 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/console.log" append="off"/>
Nov 16 00:47:59 user nova-compute[75826]:     </serial>
Nov 16 00:47:59 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:47:59 user nova-compute[75826]:     <video>
Nov 16 00:47:59 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:47:59 user nova-compute[75826]:     </video>
Nov 16 00:47:59 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:47:59 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:47:59 user nova-compute[75826]:     </rng>
Nov 16 00:47:59 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:47:59 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:47:59 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:47:59 user nova-compute[75826]:     </memballoon>
Nov 16 00:47:59 user nova-compute[75826]:   </devices>
Nov 16 00:47:59 user nova-compute[75826]: </domain>
Nov 16 00:47:59 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:47:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1322313404',display_name='tempest-ServerRescueNegativeTestJSON-server-1322313404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1322313404',id=26,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c7dc71f0e2f439f9944bd7410db7e08',ramdisk_id='',reservation_id='r-40x83n17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2102246851',owner_user_name='tempest-ServerRescueNegativeTestJSON-2102246851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:47:57Z,user_data=None,user_id='923da525ba264ea4bf770e3a66319655',uuid=7d7971e0-c96d-4690-8a14-033f6dd35776,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converting VIF {"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:8f:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5d12fa2-7d94-48c1-a16f-e7330a19ccef,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d12fa2-7d') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG os_vif [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:8f:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5d12fa2-7d94-48c1-a16f-e7330a19ccef,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d12fa2-7d') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7d0757a-267d-5fab-9ea2-31a5a50d832b', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5d12fa2-7d, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5d12fa2-7d, col_values=(('qos', UUID('7ca5df24-e1d6-4c37-ab18-c3702aeaff9a')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5d12fa2-7d, col_values=(('external_ids', {'iface-id': 'f5d12fa2-7d94-48c1-a16f-e7330a19ccef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:8f:6d', 'vm-uuid': '7d7971e0-c96d-4690-8a14-033f6dd35776'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:47:59 user nova-compute[75826]: INFO os_vif [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:8f:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5d12fa2-7d94-48c1-a16f-e7330a19ccef,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d12fa2-7d')
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:47:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No VIF found with MAC fa:16:3e:53:8f:6d, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-5af886f3-e9d2-4d0e-bc98-275b288a158b req-042d6b13-4e51-4d78-a49a-bc341bec29d7 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received event network-changed-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-5af886f3-e9d2-4d0e-bc98-275b288a158b req-042d6b13-4e51-4d78-a49a-bc341bec29d7 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Refreshing instance network info cache due to event network-changed-f5d12fa2-7d94-48c1-a16f-e7330a19ccef. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5af886f3-e9d2-4d0e-bc98-275b288a158b req-042d6b13-4e51-4d78-a49a-bc341bec29d7 service nova] Acquiring lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5af886f3-e9d2-4d0e-bc98-275b288a158b req-042d6b13-4e51-4d78-a49a-bc341bec29d7 service nova] Acquired lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG nova.network.neutron [req-5af886f3-e9d2-4d0e-bc98-275b288a158b req-042d6b13-4e51-4d78-a49a-bc341bec29d7 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Refreshing network info cache for port f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-292fb7e1-a26b-4a56-bb30-e88697b0b425 req-697f4c61-49a9-44a9-bf8a-c7a265b91fb0 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-292fb7e1-a26b-4a56-bb30-e88697b0b425 req-697f4c61-49a9-44a9-bf8a-c7a265b91fb0 service nova] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-292fb7e1-a26b-4a56-bb30-e88697b0b425 req-697f4c61-49a9-44a9-bf8a-c7a265b91fb0 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-292fb7e1-a26b-4a56-bb30-e88697b0b425 req-697f4c61-49a9-44a9-bf8a-c7a265b91fb0 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-292fb7e1-a26b-4a56-bb30-e88697b0b425 req-697f4c61-49a9-44a9-bf8a-c7a265b91fb0 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] No waiting events found dispatching network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:00 user nova-compute[75826]: WARNING nova.compute.manager [req-292fb7e1-a26b-4a56-bb30-e88697b0b425 req-697f4c61-49a9-44a9-bf8a-c7a265b91fb0 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received unexpected event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 for instance with vm_state building and task_state spawning.
Nov 16 00:48:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG nova.network.neutron [req-5af886f3-e9d2-4d0e-bc98-275b288a158b req-042d6b13-4e51-4d78-a49a-bc341bec29d7 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Updated VIF entry in instance network info cache for port f5d12fa2-7d94-48c1-a16f-e7330a19ccef. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG nova.network.neutron [req-5af886f3-e9d2-4d0e-bc98-275b288a158b req-042d6b13-4e51-4d78-a49a-bc341bec29d7 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Updating instance_info_cache with network_info: [{"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5af886f3-e9d2-4d0e-bc98-275b288a158b req-042d6b13-4e51-4d78-a49a-bc341bec29d7 service nova] Releasing lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Updating instance_info_cache with network_info: [{"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-09dad0ce-954b-406f-b6d9-9b1353fd0c38 req-37c32bc1-58fc-441c-a78b-5d4c9affeb96 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received event network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-09dad0ce-954b-406f-b6d9-9b1353fd0c38 req-37c32bc1-58fc-441c-a78b-5d4c9affeb96 service nova] Acquiring lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-09dad0ce-954b-406f-b6d9-9b1353fd0c38 req-37c32bc1-58fc-441c-a78b-5d4c9affeb96 service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-09dad0ce-954b-406f-b6d9-9b1353fd0c38 req-37c32bc1-58fc-441c-a78b-5d4c9affeb96 service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-09dad0ce-954b-406f-b6d9-9b1353fd0c38 req-37c32bc1-58fc-441c-a78b-5d4c9affeb96 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] No waiting events found dispatching network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:02 user nova-compute[75826]: WARNING nova.compute.manager [req-09dad0ce-954b-406f-b6d9-9b1353fd0c38 req-37c32bc1-58fc-441c-a78b-5d4c9affeb96 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received unexpected event network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef for instance with vm_state building and task_state spawning.
Nov 16 00:48:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-7d640544-e297-41c9-b724-ff6b3c21f034 req-cc086d70-ce34-45c7-881c-0c7b427447e6 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7d640544-e297-41c9-b724-ff6b3c21f034 req-cc086d70-ce34-45c7-881c-0c7b427447e6 service nova] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7d640544-e297-41c9-b724-ff6b3c21f034 req-cc086d70-ce34-45c7-881c-0c7b427447e6 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7d640544-e297-41c9-b724-ff6b3c21f034 req-cc086d70-ce34-45c7-881c-0c7b427447e6 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-7d640544-e297-41c9-b724-ff6b3c21f034 req-cc086d70-ce34-45c7-881c-0c7b427447e6 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] No waiting events found dispatching network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:02 user nova-compute[75826]: WARNING nova.compute.manager [req-7d640544-e297-41c9-b724-ff6b3c21f034 req-cc086d70-ce34-45c7-881c-0c7b427447e6 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received unexpected event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 for instance with vm_state building and task_state spawning.
Nov 16 00:48:03 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 is timed out.
Nov 16 00:48:03 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Successfully detached device vdb from instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 from the live domain config.
Nov 16 00:48:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fTGQcYvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:48:03 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ab56d9-0e3e-4f98-bd7b-16b81dcb5687]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:48:03 user nova-compute[75826]: No targets found.
Nov 16 00:48:03 user nova-compute[75826]: iSNS:
Nov 16 00:48:03 user nova-compute[75826]: No targets found.
Nov 16 00:48:03 user nova-compute[75826]: STATIC:
Nov 16 00:48:03 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:48:03 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:48:03 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:48:03 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087
Nov 16 00:48:03 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:48:03 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:48:03 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:48:03 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:48:03 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:48:03 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:48:03 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:48:03 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:48:03 user nova-compute[75826]: FIRMWARE:
Nov 16 00:48:03 user nova-compute[75826]: No targets found.
Nov 16 00:48:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:48:03 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:48:03 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cc6b9a-8ed2-4fe6-b278-20b4bd581c24]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc0772d-ba87-4fa5-a914-c947ca0d973e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:48:03 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:48:03 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:48:03 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:48:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:48:03 user nova-compute[75826]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 (non-flash)
Nov 16 00:48:03 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:48:03 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:48:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd944be170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087'): ({'sde'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Removing single pathed devices sde {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ba8aa8-1487-4937-a1f4-9499fa25bde4]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f242577-a4f3-48bd-8c02-c8101eb9f104]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flushing IO for device /dev/sde {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0bb853-6fd6-41b5-8db2-1a2bd2b553c4]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:03 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Instance spawned successfully.
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2059818d-b65d-4e6b-b506-316fe7e838ad]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a38a4e-83a9-4938-a302-a7d3b7b1776e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab8a004-c243-4926-8bd9-bf81d90a2b77]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260]
Nov 16 00:48:03 user nova-compute[75826]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087, portal: 172.16.0.220,3260] successful.
Nov 16 00:48:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:03 user nova-compute[75826]: INFO nova.compute.manager [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Took 7.59 seconds to spawn the instance on the hypervisor.
Nov 16 00:48:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88fa2ef5-c0dd-4acb-8376-9e74e9e0c087 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e689463-be04-4577-86e0-86105f9db57e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] <== disconnect_volume: return (349ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:03 user nova-compute[75826]: INFO nova.compute.manager [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Took 8.44 seconds to build instance.
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-110ef2a6-7bf7-46d7-8de5-4893c53ca418 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "574817b0-a25c-4da1-9ce6-804008e8279c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.532s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:48:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG nova.compute.manager [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:48:04 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Instance spawned successfully.
Nov 16 00:48:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:04 user nova-compute[75826]: INFO nova.compute.manager [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Took 7.01 seconds to spawn the instance on the hypervisor.
Nov 16 00:48:04 user nova-compute[75826]: DEBUG nova.compute.manager [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:04 user nova-compute[75826]: INFO nova.compute.manager [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Took 8.05 seconds to build instance.
Nov 16 00:48:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-c31f007f-2aeb-463b-9195-4dcaaf726b34 req-0eca81c0-bbf8-4283-9df8-609f4ae857bd service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received event network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c31f007f-2aeb-463b-9195-4dcaaf726b34 req-0eca81c0-bbf8-4283-9df8-609f4ae857bd service nova] Acquiring lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c31f007f-2aeb-463b-9195-4dcaaf726b34 req-0eca81c0-bbf8-4283-9df8-609f4ae857bd service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c31f007f-2aeb-463b-9195-4dcaaf726b34 req-0eca81c0-bbf8-4283-9df8-609f4ae857bd service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-c31f007f-2aeb-463b-9195-4dcaaf726b34 req-0eca81c0-bbf8-4283-9df8-609f4ae857bd service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] No waiting events found dispatching network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:04 user nova-compute[75826]: WARNING nova.compute.manager [req-c31f007f-2aeb-463b-9195-4dcaaf726b34 req-0eca81c0-bbf8-4283-9df8-609f4ae857bd service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received unexpected event network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef for instance with vm_state active and task_state None.
Nov 16 00:48:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-239ba95a-4c53-4fa5-a0df-7258827bb7fd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.148s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG nova.objects.instance [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lazy-loading 'flavor' on Instance uuid 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bc6138ca-433e-43f6-8b48-e23ca998d90d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.118s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:05 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:48:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:07 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:48:07 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:48:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7652MB free_disk=25.390098571777344GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:48:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 298c8986-b91b-4f46-bcce-75e28bc02b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 87b2703e-0154-445e-b659-5f5cf1d9f8f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:48:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.565s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:09 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:48:09 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:48:09 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:48:09 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:48:09 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:48:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:48:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:10 user nova-compute[75826]: DEBUG nova.compute.manager [req-94319792-aba7-4b8e-91a1-b2a751d94359 req-444fa4e1-e020-4bc8-ad74-676b5403d26e service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Received event network-changed-20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:10 user nova-compute[75826]: DEBUG nova.compute.manager [req-94319792-aba7-4b8e-91a1-b2a751d94359 req-444fa4e1-e020-4bc8-ad74-676b5403d26e service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Refreshing instance network info cache due to event network-changed-20542643-dc4b-4716-bf96-31e9bbd727e1. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:48:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-94319792-aba7-4b8e-91a1-b2a751d94359 req-444fa4e1-e020-4bc8-ad74-676b5403d26e service nova] Acquiring lock "refresh_cache-b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:48:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-94319792-aba7-4b8e-91a1-b2a751d94359 req-444fa4e1-e020-4bc8-ad74-676b5403d26e service nova] Acquired lock "refresh_cache-b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:48:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-94319792-aba7-4b8e-91a1-b2a751d94359 req-444fa4e1-e020-4bc8-ad74-676b5403d26e service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Refreshing network info cache for port 20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:48:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-94319792-aba7-4b8e-91a1-b2a751d94359 req-444fa4e1-e020-4bc8-ad74-676b5403d26e service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Updated VIF entry in instance network info cache for port 20542643-dc4b-4716-bf96-31e9bbd727e1. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:48:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-94319792-aba7-4b8e-91a1-b2a751d94359 req-444fa4e1-e020-4bc8-ad74-676b5403d26e service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Updating instance_info_cache with network_info: [{"id": "20542643-dc4b-4716-bf96-31e9bbd727e1", "address": "fa:16:3e:98:06:9c", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20542643-dc", "ovs_interfaceid": "20542643-dc4b-4716-bf96-31e9bbd727e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-94319792-aba7-4b8e-91a1-b2a751d94359 req-444fa4e1-e020-4bc8-ad74-676b5403d26e service nova] Releasing lock "refresh_cache-b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:48:11 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 is timed out.
Nov 16 00:48:11 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Successfully detached device vdc from instance 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 from the live domain config.
Nov 16 00:48:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FGtgqiDr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:48:11 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0101af-1a28-4ef1-9f31-1818b4ee8c5a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:48:11 user nova-compute[75826]: No targets found.
Nov 16 00:48:11 user nova-compute[75826]: iSNS:
Nov 16 00:48:11 user nova-compute[75826]: No targets found.
Nov 16 00:48:11 user nova-compute[75826]: STATIC:
Nov 16 00:48:11 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:48:11 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:48:11 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:48:11 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea
Nov 16 00:48:11 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:48:11 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:48:11 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:48:11 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:48:11 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:48:11 user nova-compute[75826]: FIRMWARE:
Nov 16 00:48:11 user nova-compute[75826]: No targets found.
Nov 16 00:48:11 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:48:11 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:48:11 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b34cbb7-decc-47ee-8bbd-3cc304c44373]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80c89df-9b73-40c4-9af1-a22ceaf2c189]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:48:11 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:48:11 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:48:11 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:48:11 user nova-compute[75826]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea (non-flash)
Nov 16 00:48:11 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:48:11 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd942ad6c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea'): ({'sdi'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Removing single pathed devices sdi {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e636b68-579c-45b6-b7e0-619b05c7a789]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.035s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8721e9d8-37d8-46ce-b354-1497b6ebe56f]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Flushing IO for device /dev/sdi {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[733f7a20-a673-417b-935f-0dc69dc94148]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.048s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[117d0561-55d9-4d27-ba61-6c8d6ef2e0e0]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] SCSI volumes sdi have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e145d44-3991-4ba3-856b-8c7a9fe7b768]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee2d7c2-b0df-4403-803d-9e21587bf9d3]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea, portal: 172.16.0.220,3260]
Nov 16 00:48:11 user nova-compute[75826]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea, portal: 172.16.0.220,3260] successful.
Nov 16 00:48:11 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc41fd09-16ac-47c6-8cb4-2ba03dbe53ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c78f77-0344-489c-826b-4c6e81654a0c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] <== disconnect_volume: return (342ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:48:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:48:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:12 user nova-compute[75826]: DEBUG nova.objects.instance [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'flavor' on Instance uuid 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:48:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76184cf7-8324-4297-9da3-198c398fa35e tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.114s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG nova.objects.instance [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'flavor' on Instance uuid b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:13 user nova-compute[75826]: INFO nova.compute.manager [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Attaching volume ae4ea703-ed6d-4ae0-945f-dfa71deefc0a to /dev/vdb
Nov 16 00:48:13 user nova-compute[75826]: DEBUG os_brick.utils [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73622c2-efd4-4f58-9705-5467e88f7c74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3caa1e3-c556-47cb-9f8f-046a1f674907]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b979aad3-e082-43a0-ac70-553dd36b7ee0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abb701e-ddf0-4717-92ba-75a0fd73d593]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:48:13 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6f32b5-1ffe-46f6-ab03-f35986802a2a]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG os_brick.utils [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Updating existing volume attachment record: 31f0803f-235d-4719-a29d-2acb41736313 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:48:14 user nova-compute[75826]: INFO nova.compute.claims [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Claim successful on node user
Nov 16 00:48:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.438s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG nova.network.neutron [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:48:14 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:48:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG nova.policy [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca3f8ab341484fc6ae7176cd66e18e7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6b9da552fd49509a93b461cceb15ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:48:14 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Creating image(s)
Nov 16 00:48:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "/opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "/opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.218s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk 1073741824" returned: 0 in 0.061s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG nova.network.neutron [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Successfully created port: aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.218s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Cannot resize image /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Ensure instance console log exists: /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:16 user nova-compute[75826]: DEBUG nova.network.neutron [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Successfully updated port: aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:48:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "refresh_cache-5e4641de-b527-49ae-aea0-1821c759f9a4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:48:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquired lock "refresh_cache-5e4641de-b527-49ae-aea0-1821c759f9a4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:48:16 user nova-compute[75826]: DEBUG nova.network.neutron [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:48:16 user nova-compute[75826]: DEBUG nova.compute.manager [req-9f11d77a-e913-400c-a04e-5e48e40b8d73 req-6b6aa047-3582-4eaf-92df-a7770a8717aa service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received event network-changed-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:16 user nova-compute[75826]: DEBUG nova.compute.manager [req-9f11d77a-e913-400c-a04e-5e48e40b8d73 req-6b6aa047-3582-4eaf-92df-a7770a8717aa service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Refreshing instance network info cache due to event network-changed-aa2e60a2-3b7d-4532-82ff-49b9f83bc648. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:48:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9f11d77a-e913-400c-a04e-5e48e40b8d73 req-6b6aa047-3582-4eaf-92df-a7770a8717aa service nova] Acquiring lock "refresh_cache-5e4641de-b527-49ae-aea0-1821c759f9a4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:48:16 user nova-compute[75826]: DEBUG nova.network.neutron [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.network.neutron [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Updating instance_info_cache with network_info: [{"id": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "address": "fa:16:3e:7a:57:14", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2e60a2-3b", "ovs_interfaceid": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Releasing lock "refresh_cache-5e4641de-b527-49ae-aea0-1821c759f9a4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.compute.manager [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Instance network_info: |[{"id": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "address": "fa:16:3e:7a:57:14", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2e60a2-3b", "ovs_interfaceid": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9f11d77a-e913-400c-a04e-5e48e40b8d73 req-6b6aa047-3582-4eaf-92df-a7770a8717aa service nova] Acquired lock "refresh_cache-5e4641de-b527-49ae-aea0-1821c759f9a4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.network.neutron [req-9f11d77a-e913-400c-a04e-5e48e40b8d73 req-6b6aa047-3582-4eaf-92df-a7770a8717aa service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Refreshing network info cache for port aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Start _get_guest_xml network_info=[{"id": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "address": "fa:16:3e:7a:57:14", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2e60a2-3b", "ovs_interfaceid": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:48:17 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:48:17 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1601870779',display_name='tempest-VolumesSnapshotTestJSON-instance-1601870779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1601870779',id=27,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1MdX47cBMQU/nCPZG+GXBiHpsk5dg9ZWdTbajcjQ2Ceo/NJ+8B3s5uW1/hOz1wzdbjMuoUiUVlM0O+S4RanBrv6bwJL/BGTP3TYU5pWptGTPnkO8fgwivOdrjnXBQXkw==',key_name='tempest-keypair-1905539434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d6b9da552fd49509a93b461cceb15ad',ramdisk_id='',reservation_id='r-lv4b7jpi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1407250662',owner_user_name='tempest-VolumesSnapshotTestJSON-1407250662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca3f8ab341484fc6ae7176cd66e18e7b',uuid=5e4641de-b527-49ae-aea0-1821c759f9a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "address": "fa:16:3e:7a:57:14", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2e60a2-3b", "ovs_interfaceid": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Converting VIF {"id": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "address": "fa:16:3e:7a:57:14", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2e60a2-3b", "ovs_interfaceid": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:57:14,bridge_name='br-int',has_traffic_filtering=True,id=aa2e60a2-3b7d-4532-82ff-49b9f83bc648,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2e60a2-3b') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.objects.instance [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e4641de-b527-49ae-aea0-1821c759f9a4 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:48:17 user nova-compute[75826]:   <uuid>5e4641de-b527-49ae-aea0-1821c759f9a4</uuid>
Nov 16 00:48:17 user nova-compute[75826]:   <name>instance-0000001b</name>
Nov 16 00:48:17 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:48:17 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:48:17 user nova-compute[75826]:   <metadata>
Nov 16 00:48:17 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:48:17 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:48:17 user nova-compute[75826]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1601870779</nova:name>
Nov 16 00:48:17 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:48:17</nova:creationTime>
Nov 16 00:48:17 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:48:17 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:48:17 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:48:17 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:48:17 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:48:17 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:48:17 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:48:17 user nova-compute[75826]:       <nova:owner>
Nov 16 00:48:17 user nova-compute[75826]:         <nova:user uuid="ca3f8ab341484fc6ae7176cd66e18e7b">tempest-VolumesSnapshotTestJSON-1407250662-project-member</nova:user>
Nov 16 00:48:17 user nova-compute[75826]:         <nova:project uuid="7d6b9da552fd49509a93b461cceb15ad">tempest-VolumesSnapshotTestJSON-1407250662</nova:project>
Nov 16 00:48:17 user nova-compute[75826]:       </nova:owner>
Nov 16 00:48:17 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:48:17 user nova-compute[75826]:       <nova:ports>
Nov 16 00:48:17 user nova-compute[75826]:         <nova:port uuid="aa2e60a2-3b7d-4532-82ff-49b9f83bc648">
Nov 16 00:48:17 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 00:48:17 user nova-compute[75826]:         </nova:port>
Nov 16 00:48:17 user nova-compute[75826]:       </nova:ports>
Nov 16 00:48:17 user nova-compute[75826]:     </nova:instance>
Nov 16 00:48:17 user nova-compute[75826]:   </metadata>
Nov 16 00:48:17 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:48:17 user nova-compute[75826]:     <system>
Nov 16 00:48:17 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:48:17 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:48:17 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:48:17 user nova-compute[75826]:       <entry name="serial">5e4641de-b527-49ae-aea0-1821c759f9a4</entry>
Nov 16 00:48:17 user nova-compute[75826]:       <entry name="uuid">5e4641de-b527-49ae-aea0-1821c759f9a4</entry>
Nov 16 00:48:17 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:48:17 user nova-compute[75826]:     </system>
Nov 16 00:48:17 user nova-compute[75826]:   </sysinfo>
Nov 16 00:48:17 user nova-compute[75826]:   <os>
Nov 16 00:48:17 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:48:17 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:48:17 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:48:17 user nova-compute[75826]:   </os>
Nov 16 00:48:17 user nova-compute[75826]:   <features>
Nov 16 00:48:17 user nova-compute[75826]:     <acpi/>
Nov 16 00:48:17 user nova-compute[75826]:     <apic/>
Nov 16 00:48:17 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:48:17 user nova-compute[75826]:   </features>
Nov 16 00:48:17 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:48:17 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:48:17 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:48:17 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:48:17 user nova-compute[75826]:   </clock>
Nov 16 00:48:17 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:48:17 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:48:17 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:48:17 user nova-compute[75826]:   </cpu>
Nov 16 00:48:17 user nova-compute[75826]:   <devices>
Nov 16 00:48:17 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:48:17 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:48:17 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk"/>
Nov 16 00:48:17 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:48:17 user nova-compute[75826]:     </disk>
Nov 16 00:48:17 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:48:17 user nova-compute[75826]:       <mac address="fa:16:3e:7a:57:14"/>
Nov 16 00:48:17 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:48:17 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:48:17 user nova-compute[75826]:       <target dev="tapaa2e60a2-3b"/>
Nov 16 00:48:17 user nova-compute[75826]:     </interface>
Nov 16 00:48:17 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:48:17 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/console.log" append="off"/>
Nov 16 00:48:17 user nova-compute[75826]:     </serial>
Nov 16 00:48:17 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:48:17 user nova-compute[75826]:     <video>
Nov 16 00:48:17 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:48:17 user nova-compute[75826]:     </video>
Nov 16 00:48:17 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:48:17 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:48:17 user nova-compute[75826]:     </rng>
Nov 16 00:48:17 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:48:17 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:48:17 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:48:17 user nova-compute[75826]:     </memballoon>
Nov 16 00:48:17 user nova-compute[75826]:   </devices>
Nov 16 00:48:17 user nova-compute[75826]: </domain>
Nov 16 00:48:17 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1601870779',display_name='tempest-VolumesSnapshotTestJSON-instance-1601870779',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1601870779',id=27,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1MdX47cBMQU/nCPZG+GXBiHpsk5dg9ZWdTbajcjQ2Ceo/NJ+8B3s5uW1/hOz1wzdbjMuoUiUVlM0O+S4RanBrv6bwJL/BGTP3TYU5pWptGTPnkO8fgwivOdrjnXBQXkw==',key_name='tempest-keypair-1905539434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d6b9da552fd49509a93b461cceb15ad',ramdisk_id='',reservation_id='r-lv4b7jpi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1407250662',owner_user_name='tempest-VolumesSnapshotTestJSON-1407250662-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:48:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca3f8ab341484fc6ae7176cd66e18e7b',uuid=5e4641de-b527-49ae-aea0-1821c759f9a4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "address": "fa:16:3e:7a:57:14", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2e60a2-3b", "ovs_interfaceid": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Converting VIF {"id": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "address": "fa:16:3e:7a:57:14", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2e60a2-3b", "ovs_interfaceid": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:57:14,bridge_name='br-int',has_traffic_filtering=True,id=aa2e60a2-3b7d-4532-82ff-49b9f83bc648,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2e60a2-3b') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG os_vif [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:57:14,bridge_name='br-int',has_traffic_filtering=True,id=aa2e60a2-3b7d-4532-82ff-49b9f83bc648,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2e60a2-3b') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64ba435e-7ee1-542a-b0c3-eb3e79efac19', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa2e60a2-3b, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa2e60a2-3b, col_values=(('qos', UUID('73229670-90d8-4bdc-bf8c-3190addc218e')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa2e60a2-3b, col_values=(('external_ids', {'iface-id': 'aa2e60a2-3b7d-4532-82ff-49b9f83bc648', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:57:14', 'vm-uuid': '5e4641de-b527-49ae-aea0-1821c759f9a4'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:17 user nova-compute[75826]: INFO os_vif [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:57:14,bridge_name='br-int',has_traffic_filtering=True,id=aa2e60a2-3b7d-4532-82ff-49b9f83bc648,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2e60a2-3b')
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] No VIF found with MAC fa:16:3e:7a:57:14, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.network.neutron [req-9f11d77a-e913-400c-a04e-5e48e40b8d73 req-6b6aa047-3582-4eaf-92df-a7770a8717aa service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Updated VIF entry in instance network info cache for port aa2e60a2-3b7d-4532-82ff-49b9f83bc648. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG nova.network.neutron [req-9f11d77a-e913-400c-a04e-5e48e40b8d73 req-6b6aa047-3582-4eaf-92df-a7770a8717aa service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Updating instance_info_cache with network_info: [{"id": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "address": "fa:16:3e:7a:57:14", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2e60a2-3b", "ovs_interfaceid": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:48:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9f11d77a-e913-400c-a04e-5e48e40b8d73 req-6b6aa047-3582-4eaf-92df-a7770a8717aa service nova] Releasing lock "refresh_cache-5e4641de-b527-49ae-aea0-1821c759f9a4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liNbKdXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:48:18 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:48:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:48:18 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:48:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:48:18 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9208805-e0cb-41b0-af52-a9587ae119a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:48:18 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[702a8713-6165-4d2a-b749-4557bb23f253]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a] added
Nov 16 00:48:18 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39bf104-621c-40f9-910c-a327f18295cf]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4f44e9d-1b9f-437d-90f4-d5aa0bd61326]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liNbKdXO {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v liNbKdXO" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[332547c2-f12d-45fd-aed6-c8c1d819fa39]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'liNbKdXO'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb4ae66-7fb2-409f-a98f-42454c757852]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7e793d-cbf2-477e-bd36-b537ced535fd]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:48:18 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:48:18 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:48:18 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:48:18 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:48:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1959831c-6db5-4e0e-8f4d-dfab9d966d57]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a, portal: 172.16.0.220,3260]
Nov 16 00:48:19 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a, portal: 172.16.0.220,3260] successful.
Nov 16 00:48:19 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a2c1f8-501f-4238-81b3-16591ce2ca0f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0f806c-f666-4d31-ab04-ee2759044bac]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:48:19 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:48:19 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:48:19 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:48:19 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:48:19 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:48:19 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.037s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[343308f3-edf7-4ad3-9797-9b4b07812b1f]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liNbKdXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG nova.compute.manager [req-70bd395a-b547-42be-b12a-92afeff1249b req-430fdf41-b4ee-4248-92c2-d2bc4a64fd03 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received event network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-70bd395a-b547-42be-b12a-92afeff1249b req-430fdf41-b4ee-4248-92c2-d2bc4a64fd03 service nova] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-70bd395a-b547-42be-b12a-92afeff1249b req-430fdf41-b4ee-4248-92c2-d2bc4a64fd03 service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-70bd395a-b547-42be-b12a-92afeff1249b req-430fdf41-b4ee-4248-92c2-d2bc4a64fd03 service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG nova.compute.manager [req-70bd395a-b547-42be-b12a-92afeff1249b req-430fdf41-b4ee-4248-92c2-d2bc4a64fd03 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] No waiting events found dispatching network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:19 user nova-compute[75826]: WARNING nova.compute.manager [req-70bd395a-b547-42be-b12a-92afeff1249b req-430fdf41-b4ee-4248-92c2-d2bc4a64fd03 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received unexpected event network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 for instance with vm_state building and task_state spawning.
Nov 16 00:48:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:20 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:48:20 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23662653766643735', 'path': '/dev/sdc'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:48:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23662653766643735', 'path': '/dev/sdc'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:48:20 user nova-compute[75826]: DEBUG nova.objects.instance [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'flavor' on Instance uuid b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:48:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:48:20 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:48:20 user nova-compute[75826]:   <source dev="/dev/sdc"/>
Nov 16 00:48:20 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:48:20 user nova-compute[75826]:   <serial>ae4ea703-ed6d-4ae0-945f-dfa71deefc0a</serial>
Nov 16 00:48:20 user nova-compute[75826]: </disk>
Nov 16 00:48:20 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:48:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:48:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:48:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No VIF found with MAC fa:16:3e:98:06:9c, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:48:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fa84f0dd-51f5-4d41-9955-8d0946fe82b7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.325s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:21 user nova-compute[75826]: DEBUG nova.compute.manager [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:48:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:48:21 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Instance spawned successfully.
Nov 16 00:48:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:48:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-7d6fbe71-ee8c-4c62-a642-879d4b6c71ac req-b4bd5257-f8fc-49a3-b981-73841732b9ca service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received event network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7d6fbe71-ee8c-4c62-a642-879d4b6c71ac req-b4bd5257-f8fc-49a3-b981-73841732b9ca service nova] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7d6fbe71-ee8c-4c62-a642-879d4b6c71ac req-b4bd5257-f8fc-49a3-b981-73841732b9ca service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7d6fbe71-ee8c-4c62-a642-879d4b6c71ac req-b4bd5257-f8fc-49a3-b981-73841732b9ca service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-7d6fbe71-ee8c-4c62-a642-879d4b6c71ac req-b4bd5257-f8fc-49a3-b981-73841732b9ca service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] No waiting events found dispatching network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:21 user nova-compute[75826]: WARNING nova.compute.manager [req-7d6fbe71-ee8c-4c62-a642-879d4b6c71ac req-b4bd5257-f8fc-49a3-b981-73841732b9ca service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received unexpected event network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 for instance with vm_state building and task_state spawning.
Nov 16 00:48:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:21 user nova-compute[75826]: INFO nova.compute.manager [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Took 6.54 seconds to spawn the instance on the hypervisor.
Nov 16 00:48:21 user nova-compute[75826]: DEBUG nova.compute.manager [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:48:21 user nova-compute[75826]: INFO nova.compute.manager [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Took 7.47 seconds to build instance.
Nov 16 00:48:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-90a1e061-2cef-4aac-83c0-f5b00b01711e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.567s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:23 user nova-compute[75826]: DEBUG nova.compute.manager [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:48:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:23 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:48:23 user nova-compute[75826]: INFO nova.compute.claims [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Claim successful on node user
Nov 16 00:48:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG nova.compute.manager [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG nova.compute.manager [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG nova.network.neutron [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:48:24 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:48:24 user nova-compute[75826]: DEBUG nova.compute.manager [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG nova.policy [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e2d1a7cea414446842b5abfc9fe93de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ad3ee3a8e04d728243e886a1460cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG nova.compute.manager [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:48:24 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Creating image(s)
Nov 16 00:48:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "/opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "/opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "/opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:24 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk 1073741824" returned: 0 in 0.056s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Cannot resize image /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Ensure instance console log exists: /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:25 user nova-compute[75826]: DEBUG nova.network.neutron [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Successfully created port: 10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.network.neutron [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Successfully updated port: 10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "refresh_cache-13857dd8-0db8-4a60-ad86-36c8c295fc6e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquired lock "refresh_cache-13857dd8-0db8-4a60-ad86-36c8c295fc6e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.network.neutron [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-6bf946be-eb2a-4051-83b3-513f4f2af544 req-82bc8674-ef98-4de5-aec8-e77c88e983bd service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Received event network-changed-10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-6bf946be-eb2a-4051-83b3-513f4f2af544 req-82bc8674-ef98-4de5-aec8-e77c88e983bd service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Refreshing instance network info cache due to event network-changed-10e28ff4-7e94-41c1-aff1-0da319029625. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6bf946be-eb2a-4051-83b3-513f4f2af544 req-82bc8674-ef98-4de5-aec8-e77c88e983bd service nova] Acquiring lock "refresh_cache-13857dd8-0db8-4a60-ad86-36c8c295fc6e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.network.neutron [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.network.neutron [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Updating instance_info_cache with network_info: [{"id": "10e28ff4-7e94-41c1-aff1-0da319029625", "address": "fa:16:3e:df:db:96", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e28ff4-7e", "ovs_interfaceid": "10e28ff4-7e94-41c1-aff1-0da319029625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Releasing lock "refresh_cache-13857dd8-0db8-4a60-ad86-36c8c295fc6e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Instance network_info: |[{"id": "10e28ff4-7e94-41c1-aff1-0da319029625", "address": "fa:16:3e:df:db:96", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e28ff4-7e", "ovs_interfaceid": "10e28ff4-7e94-41c1-aff1-0da319029625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6bf946be-eb2a-4051-83b3-513f4f2af544 req-82bc8674-ef98-4de5-aec8-e77c88e983bd service nova] Acquired lock "refresh_cache-13857dd8-0db8-4a60-ad86-36c8c295fc6e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.network.neutron [req-6bf946be-eb2a-4051-83b3-513f4f2af544 req-82bc8674-ef98-4de5-aec8-e77c88e983bd service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Refreshing network info cache for port 10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Start _get_guest_xml network_info=[{"id": "10e28ff4-7e94-41c1-aff1-0da319029625", "address": "fa:16:3e:df:db:96", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e28ff4-7e", "ovs_interfaceid": "10e28ff4-7e94-41c1-aff1-0da319029625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:48:26 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:48:26 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:48:26 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-784657056',display_name='tempest-AttachVolumeNegativeTest-server-784657056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-784657056',id=28,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVKkX36k0SgNST5x5wkvrF9nYJe5UCzKG+ApKxzJdsTXgeTjNNeJSkYEwMmt0vUNOsoHzZ1JlsYfxZUOnKgsme1XeIlUx9/WofsZyLxLtJuJnMf7+HIpvvgRD8KtFgGiw==',key_name='tempest-keypair-1180291907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ad3ee3a8e04d728243e886a1460cae',ramdisk_id='',reservation_id='r-2f1jz8m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471555798',owner_user_name='tempest-AttachVolumeNegativeTest-471555798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:48:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e2d1a7cea414446842b5abfc9fe93de',uuid=13857dd8-0db8-4a60-ad86-36c8c295fc6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10e28ff4-7e94-41c1-aff1-0da319029625", "address": "fa:16:3e:df:db:96", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e28ff4-7e", "ovs_interfaceid": "10e28ff4-7e94-41c1-aff1-0da319029625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converting VIF {"id": "10e28ff4-7e94-41c1-aff1-0da319029625", "address": "fa:16:3e:df:db:96", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e28ff4-7e", "ovs_interfaceid": "10e28ff4-7e94-41c1-aff1-0da319029625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:db:96,bridge_name='br-int',has_traffic_filtering=True,id=10e28ff4-7e94-41c1-aff1-0da319029625,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e28ff4-7e') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG nova.objects.instance [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'pci_devices' on Instance uuid 13857dd8-0db8-4a60-ad86-36c8c295fc6e {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:48:27 user nova-compute[75826]:   <uuid>13857dd8-0db8-4a60-ad86-36c8c295fc6e</uuid>
Nov 16 00:48:27 user nova-compute[75826]:   <name>instance-0000001c</name>
Nov 16 00:48:27 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:48:27 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:48:27 user nova-compute[75826]:   <metadata>
Nov 16 00:48:27 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:48:27 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:48:27 user nova-compute[75826]:       <nova:name>tempest-AttachVolumeNegativeTest-server-784657056</nova:name>
Nov 16 00:48:27 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:48:26</nova:creationTime>
Nov 16 00:48:27 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:48:27 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:48:27 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:48:27 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:48:27 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:48:27 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:48:27 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:48:27 user nova-compute[75826]:       <nova:owner>
Nov 16 00:48:27 user nova-compute[75826]:         <nova:user uuid="0e2d1a7cea414446842b5abfc9fe93de">tempest-AttachVolumeNegativeTest-471555798-project-member</nova:user>
Nov 16 00:48:27 user nova-compute[75826]:         <nova:project uuid="13ad3ee3a8e04d728243e886a1460cae">tempest-AttachVolumeNegativeTest-471555798</nova:project>
Nov 16 00:48:27 user nova-compute[75826]:       </nova:owner>
Nov 16 00:48:27 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:48:27 user nova-compute[75826]:       <nova:ports>
Nov 16 00:48:27 user nova-compute[75826]:         <nova:port uuid="10e28ff4-7e94-41c1-aff1-0da319029625">
Nov 16 00:48:27 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 00:48:27 user nova-compute[75826]:         </nova:port>
Nov 16 00:48:27 user nova-compute[75826]:       </nova:ports>
Nov 16 00:48:27 user nova-compute[75826]:     </nova:instance>
Nov 16 00:48:27 user nova-compute[75826]:   </metadata>
Nov 16 00:48:27 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:48:27 user nova-compute[75826]:     <system>
Nov 16 00:48:27 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:48:27 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:48:27 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:48:27 user nova-compute[75826]:       <entry name="serial">13857dd8-0db8-4a60-ad86-36c8c295fc6e</entry>
Nov 16 00:48:27 user nova-compute[75826]:       <entry name="uuid">13857dd8-0db8-4a60-ad86-36c8c295fc6e</entry>
Nov 16 00:48:27 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:48:27 user nova-compute[75826]:     </system>
Nov 16 00:48:27 user nova-compute[75826]:   </sysinfo>
Nov 16 00:48:27 user nova-compute[75826]:   <os>
Nov 16 00:48:27 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:48:27 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:48:27 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:48:27 user nova-compute[75826]:   </os>
Nov 16 00:48:27 user nova-compute[75826]:   <features>
Nov 16 00:48:27 user nova-compute[75826]:     <acpi/>
Nov 16 00:48:27 user nova-compute[75826]:     <apic/>
Nov 16 00:48:27 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:48:27 user nova-compute[75826]:   </features>
Nov 16 00:48:27 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:48:27 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:48:27 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:48:27 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:48:27 user nova-compute[75826]:   </clock>
Nov 16 00:48:27 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:48:27 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:48:27 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:48:27 user nova-compute[75826]:   </cpu>
Nov 16 00:48:27 user nova-compute[75826]:   <devices>
Nov 16 00:48:27 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:48:27 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:48:27 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk"/>
Nov 16 00:48:27 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:48:27 user nova-compute[75826]:     </disk>
Nov 16 00:48:27 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:48:27 user nova-compute[75826]:       <mac address="fa:16:3e:df:db:96"/>
Nov 16 00:48:27 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:48:27 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:48:27 user nova-compute[75826]:       <target dev="tap10e28ff4-7e"/>
Nov 16 00:48:27 user nova-compute[75826]:     </interface>
Nov 16 00:48:27 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:48:27 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/console.log" append="off"/>
Nov 16 00:48:27 user nova-compute[75826]:     </serial>
Nov 16 00:48:27 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:48:27 user nova-compute[75826]:     <video>
Nov 16 00:48:27 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:48:27 user nova-compute[75826]:     </video>
Nov 16 00:48:27 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:48:27 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:48:27 user nova-compute[75826]:     </rng>
Nov 16 00:48:27 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:48:27 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:48:27 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:48:27 user nova-compute[75826]:     </memballoon>
Nov 16 00:48:27 user nova-compute[75826]:   </devices>
Nov 16 00:48:27 user nova-compute[75826]: </domain>
Nov 16 00:48:27 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-784657056',display_name='tempest-AttachVolumeNegativeTest-server-784657056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-784657056',id=28,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVKkX36k0SgNST5x5wkvrF9nYJe5UCzKG+ApKxzJdsTXgeTjNNeJSkYEwMmt0vUNOsoHzZ1JlsYfxZUOnKgsme1XeIlUx9/WofsZyLxLtJuJnMf7+HIpvvgRD8KtFgGiw==',key_name='tempest-keypair-1180291907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ad3ee3a8e04d728243e886a1460cae',ramdisk_id='',reservation_id='r-2f1jz8m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471555798',owner_user_name='tempest-AttachVolumeNegativeTest-471555798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:48:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e2d1a7cea414446842b5abfc9fe93de',uuid=13857dd8-0db8-4a60-ad86-36c8c295fc6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10e28ff4-7e94-41c1-aff1-0da319029625", "address": "fa:16:3e:df:db:96", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e28ff4-7e", "ovs_interfaceid": "10e28ff4-7e94-41c1-aff1-0da319029625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converting VIF {"id": "10e28ff4-7e94-41c1-aff1-0da319029625", "address": "fa:16:3e:df:db:96", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e28ff4-7e", "ovs_interfaceid": "10e28ff4-7e94-41c1-aff1-0da319029625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:db:96,bridge_name='br-int',has_traffic_filtering=True,id=10e28ff4-7e94-41c1-aff1-0da319029625,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e28ff4-7e') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG os_vif [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:db:96,bridge_name='br-int',has_traffic_filtering=True,id=10e28ff4-7e94-41c1-aff1-0da319029625,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e28ff4-7e') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2c159300-6509-5f4f-a758-4c039b7c9170', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10e28ff4-7e, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10e28ff4-7e, col_values=(('qos', UUID('0af8482b-1210-4d26-80fe-3a2ccca6c87c')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10e28ff4-7e, col_values=(('external_ids', {'iface-id': '10e28ff4-7e94-41c1-aff1-0da319029625', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:db:96', 'vm-uuid': '13857dd8-0db8-4a60-ad86-36c8c295fc6e'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:27 user nova-compute[75826]: INFO os_vif [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:db:96,bridge_name='br-int',has_traffic_filtering=True,id=10e28ff4-7e94-41c1-aff1-0da319029625,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e28ff4-7e')
Nov 16 00:48:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No VIF found with MAC fa:16:3e:df:db:96, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG nova.network.neutron [req-6bf946be-eb2a-4051-83b3-513f4f2af544 req-82bc8674-ef98-4de5-aec8-e77c88e983bd service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Updated VIF entry in instance network info cache for port 10e28ff4-7e94-41c1-aff1-0da319029625. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG nova.network.neutron [req-6bf946be-eb2a-4051-83b3-513f4f2af544 req-82bc8674-ef98-4de5-aec8-e77c88e983bd service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Updating instance_info_cache with network_info: [{"id": "10e28ff4-7e94-41c1-aff1-0da319029625", "address": "fa:16:3e:df:db:96", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e28ff4-7e", "ovs_interfaceid": "10e28ff4-7e94-41c1-aff1-0da319029625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:48:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6bf946be-eb2a-4051-83b3-513f4f2af544 req-82bc8674-ef98-4de5-aec8-e77c88e983bd service nova] Releasing lock "refresh_cache-13857dd8-0db8-4a60-ad86-36c8c295fc6e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:48:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:28 user nova-compute[75826]: DEBUG nova.compute.manager [req-3da25b91-3661-48e2-a21a-41b08080c58e req-fc052575-e022-40cc-831b-9cc7fef252cd service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Received event network-vif-plugged-10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3da25b91-3661-48e2-a21a-41b08080c58e req-fc052575-e022-40cc-831b-9cc7fef252cd service nova] Acquiring lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3da25b91-3661-48e2-a21a-41b08080c58e req-fc052575-e022-40cc-831b-9cc7fef252cd service nova] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3da25b91-3661-48e2-a21a-41b08080c58e req-fc052575-e022-40cc-831b-9cc7fef252cd service nova] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:28 user nova-compute[75826]: DEBUG nova.compute.manager [req-3da25b91-3661-48e2-a21a-41b08080c58e req-fc052575-e022-40cc-831b-9cc7fef252cd service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] No waiting events found dispatching network-vif-plugged-10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:28 user nova-compute[75826]: WARNING nova.compute.manager [req-3da25b91-3661-48e2-a21a-41b08080c58e req-fc052575-e022-40cc-831b-9cc7fef252cd service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Received unexpected event network-vif-plugged-10e28ff4-7e94-41c1-aff1-0da319029625 for instance with vm_state building and task_state spawning.
Nov 16 00:48:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:48:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:48:30 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Instance spawned successfully.
Nov 16 00:48:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:48:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:48:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-fcd3a11a-26f9-4ada-a8fc-93e6a78c90a3 req-88232167-ba3b-4480-9982-fb8e85c08581 service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Received event network-vif-plugged-10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fcd3a11a-26f9-4ada-a8fc-93e6a78c90a3 req-88232167-ba3b-4480-9982-fb8e85c08581 service nova] Acquiring lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fcd3a11a-26f9-4ada-a8fc-93e6a78c90a3 req-88232167-ba3b-4480-9982-fb8e85c08581 service nova] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fcd3a11a-26f9-4ada-a8fc-93e6a78c90a3 req-88232167-ba3b-4480-9982-fb8e85c08581 service nova] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-fcd3a11a-26f9-4ada-a8fc-93e6a78c90a3 req-88232167-ba3b-4480-9982-fb8e85c08581 service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] No waiting events found dispatching network-vif-plugged-10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:30 user nova-compute[75826]: WARNING nova.compute.manager [req-fcd3a11a-26f9-4ada-a8fc-93e6a78c90a3 req-88232167-ba3b-4480-9982-fb8e85c08581 service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Received unexpected event network-vif-plugged-10e28ff4-7e94-41c1-aff1-0da319029625 for instance with vm_state building and task_state spawning.
Nov 16 00:48:30 user nova-compute[75826]: INFO nova.compute.manager [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Took 6.27 seconds to spawn the instance on the hypervisor.
Nov 16 00:48:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:48:31 user nova-compute[75826]: INFO nova.compute.manager [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Took 7.10 seconds to build instance.
Nov 16 00:48:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76321f3d-3256-4a82-b7bd-d088627a2706 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.195s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:33 user nova-compute[75826]: INFO nova.compute.manager [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Terminating instance
Nov 16 00:48:33 user nova-compute[75826]: DEBUG nova.compute.manager [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-483a1102-9684-4cf0-99b9-d1c7d0ac00f7 req-0584771f-1631-4a81-838d-4febbf305260 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-unplugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-483a1102-9684-4cf0-99b9-d1c7d0ac00f7 req-0584771f-1631-4a81-838d-4febbf305260 service nova] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-483a1102-9684-4cf0-99b9-d1c7d0ac00f7 req-0584771f-1631-4a81-838d-4febbf305260 service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-483a1102-9684-4cf0-99b9-d1c7d0ac00f7 req-0584771f-1631-4a81-838d-4febbf305260 service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-483a1102-9684-4cf0-99b9-d1c7d0ac00f7 req-0584771f-1631-4a81-838d-4febbf305260 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] No waiting events found dispatching network-vif-unplugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-483a1102-9684-4cf0-99b9-d1c7d0ac00f7 req-0584771f-1631-4a81-838d-4febbf305260 service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-unplugged-850f4dad-cf10-4839-a39f-16868c918dee for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Instance destroyed successfully.
Nov 16 00:48:34 user nova-compute[75826]: DEBUG nova.objects.instance [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lazy-loading 'resources' on Instance uuid 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T00:42:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-361931967',display_name='tempest-ServerActionsTestOtherA-server-928733355',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-361931967',id=16,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHU0KcpmTuTErG9NaY3SZVpF+AX/WxeRMWWQl0MA4gmj4gnXvVoemz++PrFyKR2DQrAESNN4t09s9GqnpqMN1S2wts2aQeEh/Ie9G5hq2y0lGk8+aBwuQnpRMCQq+GtUtg==',key_name='tempest-keypair-1288954721',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:45:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-mt01qiuk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:45:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "850f4dad-cf10-4839-a39f-16868c918dee", "address": "fa:16:3e:7c:72:81", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap850f4dad-cf", "ovs_interfaceid": "850f4dad-cf10-4839-a39f-16868c918dee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG os_vif [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap850f4dad-cf, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=26b6886e-2391-4b71-9217-dbd017918536) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: INFO os_vif [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:72:81,bridge_name='br-int',has_traffic_filtering=True,id=850f4dad-cf10-4839-a39f-16868c918dee,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap850f4dad-cf')
Nov 16 00:48:34 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Deleting instance files /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8_del
Nov 16 00:48:34 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Deletion of /opt/stack/data/nova/instances/4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8_del complete
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: INFO nova.compute.manager [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 16 00:48:34 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:48:35 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Took 1.18 seconds to deallocate network for instance.
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-43b491b6-c61b-4436-b411-eaa5dc1f13ee req-f231bacb-f2b5-4c7a-ba9d-4e5f1e60749f service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-deleted-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.005s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] No waiting events found dispatching network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:35 user nova-compute[75826]: WARNING nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received unexpected event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee for instance with vm_state deleted and task_state None.
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] No waiting events found dispatching network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:35 user nova-compute[75826]: WARNING nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received unexpected event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee for instance with vm_state deleted and task_state None.
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] No waiting events found dispatching network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:35 user nova-compute[75826]: WARNING nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received unexpected event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee for instance with vm_state deleted and task_state None.
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-unplugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] No waiting events found dispatching network-vif-unplugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:35 user nova-compute[75826]: WARNING nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received unexpected event network-vif-unplugged-850f4dad-cf10-4839-a39f-16868c918dee for instance with vm_state deleted and task_state None.
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Acquiring lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] No waiting events found dispatching network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:35 user nova-compute[75826]: WARNING nova.compute.manager [req-3368cfb2-9dad-4515-8692-62f4d4d74c24 req-70d18a7d-7bdb-4da0-a2ac-d69f1ae2bcdc service nova] [instance: 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8] Received unexpected event network-vif-plugged-850f4dad-cf10-4839-a39f-16868c918dee for instance with vm_state deleted and task_state None.
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:48:35 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:48:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:36 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Deleted allocations for instance 4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8
Nov 16 00:48:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1198890f-09df-432a-ab81-e2e5cf7a9656 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "4dec8d2b-6c39-40c7-a4ad-a2292bdf8ce8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.918s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.003s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:41 user nova-compute[75826]: INFO nova.compute.manager [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Terminating instance
Nov 16 00:48:41 user nova-compute[75826]: DEBUG nova.compute.manager [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-00a610f3-c28b-45cb-9990-4afa56b0695b req-05abac24-9a50-4049-a1da-c32f22e69a7d service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-unplugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-00a610f3-c28b-45cb-9990-4afa56b0695b req-05abac24-9a50-4049-a1da-c32f22e69a7d service nova] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-00a610f3-c28b-45cb-9990-4afa56b0695b req-05abac24-9a50-4049-a1da-c32f22e69a7d service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-00a610f3-c28b-45cb-9990-4afa56b0695b req-05abac24-9a50-4049-a1da-c32f22e69a7d service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-00a610f3-c28b-45cb-9990-4afa56b0695b req-05abac24-9a50-4049-a1da-c32f22e69a7d service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] No waiting events found dispatching network-vif-unplugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-00a610f3-c28b-45cb-9990-4afa56b0695b req-05abac24-9a50-4049-a1da-c32f22e69a7d service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-unplugged-29ee5e10-3912-41da-a701-c5034a67f421 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Instance destroyed successfully.
Nov 16 00:48:42 user nova-compute[75826]: DEBUG nova.objects.instance [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'resources' on Instance uuid 5fdf32cf-b23f-4b65-8a47-1cf913b950d9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T00:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1545772247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1545772247',id=14,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM5B66Qf+MQGsHfinCxf1C+yam25N2g58fRRofO5wiRA1j5R2phnunwEELoIaU0Cin2x5UxLqXlSqPNgeM2aMFAQihMiJ2zI238LG+ZeDaRhOUk0Ki09+Ilf/kkDnLo82w==',key_name='tempest-keypair-48608115',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:46:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c770637392a544c48a72c953bfd9e7c6',ramdisk_id='',reservation_id='r-r9359cng',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849437325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849437325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:46:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a858d73834524c86a1c5c8514270761e',uuid=5fdf32cf-b23f-4b65-8a47-1cf913b950d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converting VIF {"id": "29ee5e10-3912-41da-a701-c5034a67f421", "address": "fa:16:3e:44:bf:4c", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29ee5e10-39", "ovs_interfaceid": "29ee5e10-3912-41da-a701-c5034a67f421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG os_vif [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29ee5e10-39, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=46b096bc-e954-483f-b5bc-536fe7fd215d) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:48:42 user nova-compute[75826]: INFO os_vif [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:bf:4c,bridge_name='br-int',has_traffic_filtering=True,id=29ee5e10-3912-41da-a701-c5034a67f421,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29ee5e10-39')
Nov 16 00:48:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Deleting instance files /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9_del
Nov 16 00:48:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Deletion of /opt/stack/data/nova/instances/5fdf32cf-b23f-4b65-8a47-1cf913b950d9_del complete
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:42 user nova-compute[75826]: INFO nova.compute.manager [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 16 00:48:42 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] No waiting events found dispatching network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:43 user nova-compute[75826]: WARNING nova.compute.manager [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received unexpected event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 for instance with vm_state active and task_state deleting.
Nov 16 00:48:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] No waiting events found dispatching network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:43 user nova-compute[75826]: WARNING nova.compute.manager [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received unexpected event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 for instance with vm_state active and task_state deleting.
Nov 16 00:48:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] No waiting events found dispatching network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:43 user nova-compute[75826]: WARNING nova.compute.manager [req-38e1e406-cd86-449b-9aa2-01c9d70cf341 req-37253f93-1bff-415a-8b7f-6679480db83c service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received unexpected event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 for instance with vm_state active and task_state deleting.
Nov 16 00:48:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:44 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:48:44 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Took 2.21 seconds to deallocate network for instance.
Nov 16 00:48:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:44 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:48:44 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:48:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:44 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Deleted allocations for instance 5fdf32cf-b23f-4b65-8a47-1cf913b950d9
Nov 16 00:48:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-32c855e2-61db-4a66-8567-aa39021fa6bf tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.780s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:45 user nova-compute[75826]: DEBUG nova.compute.manager [req-00ba5fe7-547e-43aa-a3c8-df05a12cca41 req-1c1a58b5-c090-4998-9c6e-e0a9db113db3 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-unplugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-00ba5fe7-547e-43aa-a3c8-df05a12cca41 req-1c1a58b5-c090-4998-9c6e-e0a9db113db3 service nova] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-00ba5fe7-547e-43aa-a3c8-df05a12cca41 req-1c1a58b5-c090-4998-9c6e-e0a9db113db3 service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-00ba5fe7-547e-43aa-a3c8-df05a12cca41 req-1c1a58b5-c090-4998-9c6e-e0a9db113db3 service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:45 user nova-compute[75826]: DEBUG nova.compute.manager [req-00ba5fe7-547e-43aa-a3c8-df05a12cca41 req-1c1a58b5-c090-4998-9c6e-e0a9db113db3 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] No waiting events found dispatching network-vif-unplugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:45 user nova-compute[75826]: WARNING nova.compute.manager [req-00ba5fe7-547e-43aa-a3c8-df05a12cca41 req-1c1a58b5-c090-4998-9c6e-e0a9db113db3 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received unexpected event network-vif-unplugged-29ee5e10-3912-41da-a701-c5034a67f421 for instance with vm_state deleted and task_state None.
Nov 16 00:48:45 user nova-compute[75826]: DEBUG nova.compute.manager [req-00ba5fe7-547e-43aa-a3c8-df05a12cca41 req-1c1a58b5-c090-4998-9c6e-e0a9db113db3 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-00ba5fe7-547e-43aa-a3c8-df05a12cca41 req-1c1a58b5-c090-4998-9c6e-e0a9db113db3 service nova] Acquiring lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-00ba5fe7-547e-43aa-a3c8-df05a12cca41 req-1c1a58b5-c090-4998-9c6e-e0a9db113db3 service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-00ba5fe7-547e-43aa-a3c8-df05a12cca41 req-1c1a58b5-c090-4998-9c6e-e0a9db113db3 service nova] Lock "5fdf32cf-b23f-4b65-8a47-1cf913b950d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:45 user nova-compute[75826]: DEBUG nova.compute.manager [req-00ba5fe7-547e-43aa-a3c8-df05a12cca41 req-1c1a58b5-c090-4998-9c6e-e0a9db113db3 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] No waiting events found dispatching network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:45 user nova-compute[75826]: WARNING nova.compute.manager [req-00ba5fe7-547e-43aa-a3c8-df05a12cca41 req-1c1a58b5-c090-4998-9c6e-e0a9db113db3 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received unexpected event network-vif-plugged-29ee5e10-3912-41da-a701-c5034a67f421 for instance with vm_state deleted and task_state None.
Nov 16 00:48:45 user nova-compute[75826]: DEBUG nova.compute.manager [req-00ba5fe7-547e-43aa-a3c8-df05a12cca41 req-1c1a58b5-c090-4998-9c6e-e0a9db113db3 service nova] [instance: 5fdf32cf-b23f-4b65-8a47-1cf913b950d9] Received event network-vif-deleted-29ee5e10-3912-41da-a701-c5034a67f421 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "cc77d9aa-4052-40dd-9495-3a516d8f0793" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:48:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:48:54 user nova-compute[75826]: INFO nova.compute.claims [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Claim successful on node user
Nov 16 00:48:55 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.418s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG nova.network.neutron [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:48:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:48:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG nova.policy [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7ea010b69874f3eb8947e93531e6669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328112cf55d04d8c8bb1b9d5655a2115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:48:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Creating image(s)
Nov 16 00:48:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "/opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "/opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.225s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk 1073741824" returned: 0 in 0.055s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG nova.network.neutron [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Successfully created port: c606b703-1a65-4ec2-abba-8445bf5c0e26 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Cannot resize image /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Ensure instance console log exists: /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG nova.network.neutron [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Successfully updated port: c606b703-1a65-4ec2-abba-8445bf5c0e26 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "refresh_cache-cc77d9aa-4052-40dd-9495-3a516d8f0793" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquired lock "refresh_cache-cc77d9aa-4052-40dd-9495-3a516d8f0793" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG nova.network.neutron [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-90d4ba71-07d1-4ee8-af21-92d254d32e32 req-35da7575-9adc-4224-9c9b-19d0f591ae31 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Received event network-changed-c606b703-1a65-4ec2-abba-8445bf5c0e26 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-90d4ba71-07d1-4ee8-af21-92d254d32e32 req-35da7575-9adc-4224-9c9b-19d0f591ae31 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Refreshing instance network info cache due to event network-changed-c606b703-1a65-4ec2-abba-8445bf5c0e26. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90d4ba71-07d1-4ee8-af21-92d254d32e32 req-35da7575-9adc-4224-9c9b-19d0f591ae31 service nova] Acquiring lock "refresh_cache-cc77d9aa-4052-40dd-9495-3a516d8f0793" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:48:56 user nova-compute[75826]: DEBUG nova.network.neutron [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.network.neutron [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Updating instance_info_cache with network_info: [{"id": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "address": "fa:16:3e:b7:91:3a", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606b703-1a", "ovs_interfaceid": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Releasing lock "refresh_cache-cc77d9aa-4052-40dd-9495-3a516d8f0793" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Instance network_info: |[{"id": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "address": "fa:16:3e:b7:91:3a", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606b703-1a", "ovs_interfaceid": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90d4ba71-07d1-4ee8-af21-92d254d32e32 req-35da7575-9adc-4224-9c9b-19d0f591ae31 service nova] Acquired lock "refresh_cache-cc77d9aa-4052-40dd-9495-3a516d8f0793" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.network.neutron [req-90d4ba71-07d1-4ee8-af21-92d254d32e32 req-35da7575-9adc-4224-9c9b-19d0f591ae31 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Refreshing network info cache for port c606b703-1a65-4ec2-abba-8445bf5c0e26 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Start _get_guest_xml network_info=[{"id": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "address": "fa:16:3e:b7:91:3a", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606b703-1a", "ovs_interfaceid": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:48:57 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:48:57 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-646461662',display_name='tempest-ServersNegativeTestJSON-server-646461662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-646461662',id=29,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='328112cf55d04d8c8bb1b9d5655a2115',ramdisk_id='',reservation_id='r-3779duek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1135241657',owner_user_name='tempest-ServersNegativeTestJSON-1135241657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:48:56Z,user_data=None,user_id='d7ea010b69874f3eb8947e93531e6669',uuid=cc77d9aa-4052-40dd-9495-3a516d8f0793,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "address": "fa:16:3e:b7:91:3a", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606b703-1a", "ovs_interfaceid": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Converting VIF {"id": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "address": "fa:16:3e:b7:91:3a", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606b703-1a", "ovs_interfaceid": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:91:3a,bridge_name='br-int',has_traffic_filtering=True,id=c606b703-1a65-4ec2-abba-8445bf5c0e26,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606b703-1a') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.objects.instance [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lazy-loading 'pci_devices' on Instance uuid cc77d9aa-4052-40dd-9495-3a516d8f0793 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:48:57 user nova-compute[75826]:   <uuid>cc77d9aa-4052-40dd-9495-3a516d8f0793</uuid>
Nov 16 00:48:57 user nova-compute[75826]:   <name>instance-0000001d</name>
Nov 16 00:48:57 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:48:57 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:48:57 user nova-compute[75826]:   <metadata>
Nov 16 00:48:57 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:48:57 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:48:57 user nova-compute[75826]:       <nova:name>tempest-ServersNegativeTestJSON-server-646461662</nova:name>
Nov 16 00:48:57 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:48:57</nova:creationTime>
Nov 16 00:48:57 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:48:57 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:48:57 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:48:57 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:48:57 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:48:57 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:48:57 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:48:57 user nova-compute[75826]:       <nova:owner>
Nov 16 00:48:57 user nova-compute[75826]:         <nova:user uuid="d7ea010b69874f3eb8947e93531e6669">tempest-ServersNegativeTestJSON-1135241657-project-member</nova:user>
Nov 16 00:48:57 user nova-compute[75826]:         <nova:project uuid="328112cf55d04d8c8bb1b9d5655a2115">tempest-ServersNegativeTestJSON-1135241657</nova:project>
Nov 16 00:48:57 user nova-compute[75826]:       </nova:owner>
Nov 16 00:48:57 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:48:57 user nova-compute[75826]:       <nova:ports>
Nov 16 00:48:57 user nova-compute[75826]:         <nova:port uuid="c606b703-1a65-4ec2-abba-8445bf5c0e26">
Nov 16 00:48:57 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 00:48:57 user nova-compute[75826]:         </nova:port>
Nov 16 00:48:57 user nova-compute[75826]:       </nova:ports>
Nov 16 00:48:57 user nova-compute[75826]:     </nova:instance>
Nov 16 00:48:57 user nova-compute[75826]:   </metadata>
Nov 16 00:48:57 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:48:57 user nova-compute[75826]:     <system>
Nov 16 00:48:57 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:48:57 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:48:57 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:48:57 user nova-compute[75826]:       <entry name="serial">cc77d9aa-4052-40dd-9495-3a516d8f0793</entry>
Nov 16 00:48:57 user nova-compute[75826]:       <entry name="uuid">cc77d9aa-4052-40dd-9495-3a516d8f0793</entry>
Nov 16 00:48:57 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:48:57 user nova-compute[75826]:     </system>
Nov 16 00:48:57 user nova-compute[75826]:   </sysinfo>
Nov 16 00:48:57 user nova-compute[75826]:   <os>
Nov 16 00:48:57 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:48:57 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:48:57 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:48:57 user nova-compute[75826]:   </os>
Nov 16 00:48:57 user nova-compute[75826]:   <features>
Nov 16 00:48:57 user nova-compute[75826]:     <acpi/>
Nov 16 00:48:57 user nova-compute[75826]:     <apic/>
Nov 16 00:48:57 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:48:57 user nova-compute[75826]:   </features>
Nov 16 00:48:57 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:48:57 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:48:57 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:48:57 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:48:57 user nova-compute[75826]:   </clock>
Nov 16 00:48:57 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:48:57 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:48:57 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:48:57 user nova-compute[75826]:   </cpu>
Nov 16 00:48:57 user nova-compute[75826]:   <devices>
Nov 16 00:48:57 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:48:57 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:48:57 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk"/>
Nov 16 00:48:57 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:48:57 user nova-compute[75826]:     </disk>
Nov 16 00:48:57 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:48:57 user nova-compute[75826]:       <mac address="fa:16:3e:b7:91:3a"/>
Nov 16 00:48:57 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:48:57 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:48:57 user nova-compute[75826]:       <target dev="tapc606b703-1a"/>
Nov 16 00:48:57 user nova-compute[75826]:     </interface>
Nov 16 00:48:57 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:48:57 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/console.log" append="off"/>
Nov 16 00:48:57 user nova-compute[75826]:     </serial>
Nov 16 00:48:57 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:48:57 user nova-compute[75826]:     <video>
Nov 16 00:48:57 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:48:57 user nova-compute[75826]:     </video>
Nov 16 00:48:57 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:48:57 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:48:57 user nova-compute[75826]:     </rng>
Nov 16 00:48:57 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:48:57 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:48:57 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:48:57 user nova-compute[75826]:     </memballoon>
Nov 16 00:48:57 user nova-compute[75826]:   </devices>
Nov 16 00:48:57 user nova-compute[75826]: </domain>
Nov 16 00:48:57 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-646461662',display_name='tempest-ServersNegativeTestJSON-server-646461662',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-646461662',id=29,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='328112cf55d04d8c8bb1b9d5655a2115',ramdisk_id='',reservation_id='r-3779duek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1135241657',owner_user_name='tempest-ServersNegativeTestJSON-1135241657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:48:56Z,user_data=None,user_id='d7ea010b69874f3eb8947e93531e6669',uuid=cc77d9aa-4052-40dd-9495-3a516d8f0793,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "address": "fa:16:3e:b7:91:3a", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606b703-1a", "ovs_interfaceid": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Converting VIF {"id": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "address": "fa:16:3e:b7:91:3a", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606b703-1a", "ovs_interfaceid": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:91:3a,bridge_name='br-int',has_traffic_filtering=True,id=c606b703-1a65-4ec2-abba-8445bf5c0e26,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606b703-1a') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG os_vif [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:91:3a,bridge_name='br-int',has_traffic_filtering=True,id=c606b703-1a65-4ec2-abba-8445bf5c0e26,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606b703-1a') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ea3da109-0a57-5b7a-bd0a-e9165b65fa66', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc606b703-1a, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc606b703-1a, col_values=(('qos', UUID('e9481bc3-2a95-4cc8-8d74-6c0f9bc0ab83')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc606b703-1a, col_values=(('external_ids', {'iface-id': 'c606b703-1a65-4ec2-abba-8445bf5c0e26', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:91:3a', 'vm-uuid': 'cc77d9aa-4052-40dd-9495-3a516d8f0793'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:57 user nova-compute[75826]: INFO os_vif [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:91:3a,bridge_name='br-int',has_traffic_filtering=True,id=c606b703-1a65-4ec2-abba-8445bf5c0e26,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606b703-1a')
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] No VIF found with MAC fa:16:3e:b7:91:3a, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.network.neutron [req-90d4ba71-07d1-4ee8-af21-92d254d32e32 req-35da7575-9adc-4224-9c9b-19d0f591ae31 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Updated VIF entry in instance network info cache for port c606b703-1a65-4ec2-abba-8445bf5c0e26. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG nova.network.neutron [req-90d4ba71-07d1-4ee8-af21-92d254d32e32 req-35da7575-9adc-4224-9c9b-19d0f591ae31 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Updating instance_info_cache with network_info: [{"id": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "address": "fa:16:3e:b7:91:3a", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606b703-1a", "ovs_interfaceid": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:48:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90d4ba71-07d1-4ee8-af21-92d254d32e32 req-35da7575-9adc-4224-9c9b-19d0f591ae31 service nova] Releasing lock "refresh_cache-cc77d9aa-4052-40dd-9495-3a516d8f0793" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:48:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:58 user nova-compute[75826]: INFO nova.compute.manager [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Detaching volume 614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:48:58 user nova-compute[75826]: INFO nova.virt.block_device [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Attempting to driver detach volume 614386b6-09ef-4bd9-b7ff-475392da7e4c from mountpoint /dev/vdb
Nov 16 00:48:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Attempting to detach device vdb from instance 298c8986-b91b-4f46-bcce-75e28bc02b5f from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:48:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:48:58 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:48:58 user nova-compute[75826]:   <source dev="/dev/sdf"/>
Nov 16 00:48:58 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:48:58 user nova-compute[75826]:   <serial>614386b6-09ef-4bd9-b7ff-475392da7e4c</serial>
Nov 16 00:48:58 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 00:48:58 user nova-compute[75826]: </disk>
Nov 16 00:48:58 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:48:58 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully detached device vdb from instance 298c8986-b91b-4f46-bcce-75e28bc02b5f from the persistent domain config.
Nov 16 00:48:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 298c8986-b91b-4f46-bcce-75e28bc02b5f from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:48:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:48:58 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:48:58 user nova-compute[75826]:   <source dev="/dev/sdf"/>
Nov 16 00:48:58 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:48:58 user nova-compute[75826]:   <serial>614386b6-09ef-4bd9-b7ff-475392da7e4c</serial>
Nov 16 00:48:58 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 00:48:58 user nova-compute[75826]: </disk>
Nov 16 00:48:58 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:48:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:59 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:48:59 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:48:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-113cbe6b-4411-4521-82ea-8ab127a43609 req-cebd3380-a35c-4db0-9f7d-3b12a2d7ec25 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Received event network-vif-plugged-c606b703-1a65-4ec2-abba-8445bf5c0e26 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:48:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-113cbe6b-4411-4521-82ea-8ab127a43609 req-cebd3380-a35c-4db0-9f7d-3b12a2d7ec25 service nova] Acquiring lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:48:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-113cbe6b-4411-4521-82ea-8ab127a43609 req-cebd3380-a35c-4db0-9f7d-3b12a2d7ec25 service nova] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:48:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-113cbe6b-4411-4521-82ea-8ab127a43609 req-cebd3380-a35c-4db0-9f7d-3b12a2d7ec25 service nova] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:48:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-113cbe6b-4411-4521-82ea-8ab127a43609 req-cebd3380-a35c-4db0-9f7d-3b12a2d7ec25 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] No waiting events found dispatching network-vif-plugged-c606b703-1a65-4ec2-abba-8445bf5c0e26 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:48:59 user nova-compute[75826]: WARNING nova.compute.manager [req-113cbe6b-4411-4521-82ea-8ab127a43609 req-cebd3380-a35c-4db0-9f7d-3b12a2d7ec25 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Received unexpected event network-vif-plugged-c606b703-1a65-4ec2-abba-8445bf5c0e26 for instance with vm_state building and task_state spawning.
Nov 16 00:48:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:48:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:48:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:00 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:49:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:49:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:49:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:49:00 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:49:00 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Updating instance_info_cache with network_info: [{"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:49:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:49:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-b8763f72-91b6-4030-a07f-69497d747e2c req-4143145a-ee59-4d29-b245-72f599b6f8e8 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Received event network-vif-plugged-c606b703-1a65-4ec2-abba-8445bf5c0e26 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b8763f72-91b6-4030-a07f-69497d747e2c req-4143145a-ee59-4d29-b245-72f599b6f8e8 service nova] Acquiring lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b8763f72-91b6-4030-a07f-69497d747e2c req-4143145a-ee59-4d29-b245-72f599b6f8e8 service nova] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b8763f72-91b6-4030-a07f-69497d747e2c req-4143145a-ee59-4d29-b245-72f599b6f8e8 service nova] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-b8763f72-91b6-4030-a07f-69497d747e2c req-4143145a-ee59-4d29-b245-72f599b6f8e8 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] No waiting events found dispatching network-vif-plugged-c606b703-1a65-4ec2-abba-8445bf5c0e26 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:49:01 user nova-compute[75826]: WARNING nova.compute.manager [req-b8763f72-91b6-4030-a07f-69497d747e2c req-4143145a-ee59-4d29-b245-72f599b6f8e8 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Received unexpected event network-vif-plugged-c606b703-1a65-4ec2-abba-8445bf5c0e26 for instance with vm_state building and task_state spawning.
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG nova.compute.manager [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:01 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Instance spawned successfully.
Nov 16 00:49:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:49:01 user nova-compute[75826]: INFO nova.compute.manager [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 16 00:49:01 user nova-compute[75826]: DEBUG nova.compute.manager [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:01 user nova-compute[75826]: INFO nova.compute.manager [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Took 6.76 seconds to build instance.
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0eeb7a5d-c9bb-47c0-a05d-3c9101af0f68 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.869s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:49:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:49:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:05 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:49:05 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7332MB free_disk=25.31580352783203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 298c8986-b91b-4f46-bcce-75e28bc02b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 87b2703e-0154-445e-b659-5f5cf1d9f8f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 5e4641de-b527-49ae-aea0-1821c759f9a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13857dd8-0db8-4a60-ad86-36c8c295fc6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance cc77d9aa-4052-40dd-9495-3a516d8f0793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:49:05 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:49:06 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:49:06 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:49:06 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:49:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:07 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:49:07 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:49:07 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:49:07 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:49:07 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:49:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:08 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:49:08 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:49:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:19 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 298c8986-b91b-4f46-bcce-75e28bc02b5f is timed out.
Nov 16 00:49:19 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully detached device vdb from instance 298c8986-b91b-4f46-bcce-75e28bc02b5f from the live domain config.
Nov 16 00:49:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xudMsJbB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:49:19 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb2725f-d521-4c71-8608-508c343ad5b0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:49:19 user nova-compute[75826]: No targets found.
Nov 16 00:49:19 user nova-compute[75826]: iSNS:
Nov 16 00:49:19 user nova-compute[75826]: No targets found.
Nov 16 00:49:19 user nova-compute[75826]: STATIC:
Nov 16 00:49:19 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c
Nov 16 00:49:19 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:49:19 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:49:19 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a
Nov 16 00:49:19 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:49:19 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:49:19 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:49:19 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:49:19 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:49:19 user nova-compute[75826]: FIRMWARE:
Nov 16 00:49:19 user nova-compute[75826]: No targets found.
Nov 16 00:49:19 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:49:19 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:49:19 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[460a93e6-5ddd-42e3-bad8-620d054dcc56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc38bef-c39a-43ea-b6e5-2897ec717765]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:49:19 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:49:19 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:49:19 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:49:19 user nova-compute[75826]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c (non-flash)
Nov 16 00:49:19 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:49:19 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb4290f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c'): ({'sdf'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Removing single pathed devices sdf {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c31bca-d758-4ca3-94a1-88c9e30fbc72]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22a37a6-562c-4748-8738-65ea56258ab8]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Flushing IO for device /dev/sdf {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce78483-c373-4fb6-85b6-46860b21f1da]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.050s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc51f389-d35d-4af9-8aab-8a03ab40b3ea]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[de658a4e-41d3-43aa-83e9-71555c5c84df]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f770234b-1354-4b15-b837-fa5a4bb46c34]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260]
Nov 16 00:49:19 user nova-compute[75826]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c, portal: 172.16.0.220,3260] successful.
Nov 16 00:49:19 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:614386b6-09ef-4bd9-b7ff-475392da7e4c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecc160e-c6c2-45e7-bdba-7efa9f8faa01]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] <== disconnect_volume: return (323ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:49:19 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:49:20 user nova-compute[75826]: DEBUG nova.objects.instance [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'flavor' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:49:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-51ac2e74-8ba7-4c5b-b8f3-527a95c33c37 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.056s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9a5da9b2-c71d-4393-9134-bca0d184f5c2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9a5da9b2-c71d-4393-9134-bca0d184f5c2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9a5da9b2-c71d-4393-9134-bca0d184f5c2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9a5da9b2-c71d-4393-9134-bca0d184f5c2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75826) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG nova.objects.instance [None req-9a5da9b2-c71d-4393-9134-bca0d184f5c2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'flavor' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-e6271744-978b-4cfb-af55-395c315c2c56 req-22293500-bed7-44de-8788-185ee868464a service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-unplugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e6271744-978b-4cfb-af55-395c315c2c56 req-22293500-bed7-44de-8788-185ee868464a service nova] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e6271744-978b-4cfb-af55-395c315c2c56 req-22293500-bed7-44de-8788-185ee868464a service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e6271744-978b-4cfb-af55-395c315c2c56 req-22293500-bed7-44de-8788-185ee868464a service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-e6271744-978b-4cfb-af55-395c315c2c56 req-22293500-bed7-44de-8788-185ee868464a service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] No waiting events found dispatching network-vif-unplugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:49:21 user nova-compute[75826]: WARNING nova.compute.manager [req-e6271744-978b-4cfb-af55-395c315c2c56 req-22293500-bed7-44de-8788-185ee868464a service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received unexpected event network-vif-unplugged-ff64782d-047b-4488-80c5-b8866a0c5037 for instance with vm_state active and task_state powering-off.
Nov 16 00:49:21 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Instance destroyed successfully.
Nov 16 00:49:21 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9a5da9b2-c71d-4393-9134-bca0d184f5c2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:49:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9a5da9b2-c71d-4393-9134-bca0d184f5c2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.843s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-380d52c9-b78c-41ff-b851-a3d47766e34f req-0e3f7a12-476d-4dd9-8e60-1fb92d3a97fb service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:49:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-380d52c9-b78c-41ff-b851-a3d47766e34f req-0e3f7a12-476d-4dd9-8e60-1fb92d3a97fb service nova] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-380d52c9-b78c-41ff-b851-a3d47766e34f req-0e3f7a12-476d-4dd9-8e60-1fb92d3a97fb service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-380d52c9-b78c-41ff-b851-a3d47766e34f req-0e3f7a12-476d-4dd9-8e60-1fb92d3a97fb service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-380d52c9-b78c-41ff-b851-a3d47766e34f req-0e3f7a12-476d-4dd9-8e60-1fb92d3a97fb service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] No waiting events found dispatching network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:49:23 user nova-compute[75826]: WARNING nova.compute.manager [req-380d52c9-b78c-41ff-b851-a3d47766e34f req-0e3f7a12-476d-4dd9-8e60-1fb92d3a97fb service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received unexpected event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 for instance with vm_state stopped and task_state None.
Nov 16 00:49:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:29 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:49:29 user nova-compute[75826]: INFO nova.compute.manager [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] instance snapshotting
Nov 16 00:49:29 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Beginning live snapshot process
Nov 16 00:49:30 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json -f qcow2 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:30 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json -f qcow2" returned: 0 in 0.204s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:30 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json -f qcow2 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:30 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json -f qcow2" returned: 0 in 0.213s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:30 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:30 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:30 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp44_58in0/9e6823c39d6843aea088904346104af5.delta 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:30 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp44_58in0/9e6823c39d6843aea088904346104af5.delta 1073741824" returned: 0 in 0.064s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:30 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 00:49:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:49:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 00:49:32 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 00:49:32 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:49:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp44_58in0/9e6823c39d6843aea088904346104af5.delta /opt/stack/data/nova/instances/snapshots/tmp44_58in0/9e6823c39d6843aea088904346104af5 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp44_58in0/9e6823c39d6843aea088904346104af5.delta /opt/stack/data/nova/instances/snapshots/tmp44_58in0/9e6823c39d6843aea088904346104af5" returned: 0 in 0.779s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:32 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Snapshot extracted, beginning image upload
Nov 16 00:49:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:49:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:35 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:49:35 user nova-compute[75826]: INFO nova.compute.claims [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Claim successful on node user
Nov 16 00:49:36 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Snapshot image upload complete
Nov 16 00:49:36 user nova-compute[75826]: INFO nova.compute.manager [None req-c2ef5b5c-f5da-4834-b045-6173bffa18f5 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Took 6.20 seconds to snapshot the instance on the hypervisor.
Nov 16 00:49:36 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:49:36 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:49:36 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG nova.policy [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a858d73834524c86a1c5c8514270761e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c770637392a544c48a72c953bfd9e7c6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:49:36 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Creating image(s)
Nov 16 00:49:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "/opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "/opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk 1073741824" returned: 0 in 0.056s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Successfully created port: 5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Cannot resize image /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Ensure instance console log exists: /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Successfully updated port: 5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquired lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-4043b43d-3262-4058-b278-bdceb9b6bbe8 req-2df1483e-90bd-4e4d-939f-3de0f979894d service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-changed-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-4043b43d-3262-4058-b278-bdceb9b6bbe8 req-2df1483e-90bd-4e4d-939f-3de0f979894d service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Refreshing instance network info cache due to event network-changed-5c4ad1d8-e2df-47a7-9305-538ad370dfba. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4043b43d-3262-4058-b278-bdceb9b6bbe8 req-2df1483e-90bd-4e4d-939f-3de0f979894d service nova] Acquiring lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Updating instance_info_cache with network_info: [{"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Releasing lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Instance network_info: |[{"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4043b43d-3262-4058-b278-bdceb9b6bbe8 req-2df1483e-90bd-4e4d-939f-3de0f979894d service nova] Acquired lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.network.neutron [req-4043b43d-3262-4058-b278-bdceb9b6bbe8 req-2df1483e-90bd-4e4d-939f-3de0f979894d service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Refreshing network info cache for port 5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Start _get_guest_xml network_info=[{"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:49:38 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:49:38 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:49:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1266665264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1266665264',id=30,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkKOKHpjmxVwP9V7adtdz4VQBjXn7APViT1VzpK4o4RhMiapzvLBqHFVkjHnA+c0rjxqezFUAS25kHTzDm+npNVmmZXmRGAI3ibU+T6quMQQhJNAm2BD/LbwCTKFPZM3A==',key_name='tempest-keypair-1217439759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c770637392a544c48a72c953bfd9e7c6',ramdisk_id='',reservation_id='r-ip881mu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849437325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849437325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a858d73834524c86a1c5c8514270761e',uuid=cb8a1a92-10de-4bdc-b730-83bae29ff92b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converting VIF {"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'pci_devices' on Instance uuid cb8a1a92-10de-4bdc-b730-83bae29ff92b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:49:38 user nova-compute[75826]:   <uuid>cb8a1a92-10de-4bdc-b730-83bae29ff92b</uuid>
Nov 16 00:49:38 user nova-compute[75826]:   <name>instance-0000001e</name>
Nov 16 00:49:38 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:49:38 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:49:38 user nova-compute[75826]:   <metadata>
Nov 16 00:49:38 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:49:38 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:49:38 user nova-compute[75826]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1266665264</nova:name>
Nov 16 00:49:38 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:49:38</nova:creationTime>
Nov 16 00:49:38 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:49:38 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:49:38 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:49:38 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:49:38 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:49:38 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:49:38 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:49:38 user nova-compute[75826]:       <nova:owner>
Nov 16 00:49:38 user nova-compute[75826]:         <nova:user uuid="a858d73834524c86a1c5c8514270761e">tempest-AttachVolumeShelveTestJSON-1849437325-project-member</nova:user>
Nov 16 00:49:38 user nova-compute[75826]:         <nova:project uuid="c770637392a544c48a72c953bfd9e7c6">tempest-AttachVolumeShelveTestJSON-1849437325</nova:project>
Nov 16 00:49:38 user nova-compute[75826]:       </nova:owner>
Nov 16 00:49:38 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:49:38 user nova-compute[75826]:       <nova:ports>
Nov 16 00:49:38 user nova-compute[75826]:         <nova:port uuid="5c4ad1d8-e2df-47a7-9305-538ad370dfba">
Nov 16 00:49:38 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 00:49:38 user nova-compute[75826]:         </nova:port>
Nov 16 00:49:38 user nova-compute[75826]:       </nova:ports>
Nov 16 00:49:38 user nova-compute[75826]:     </nova:instance>
Nov 16 00:49:38 user nova-compute[75826]:   </metadata>
Nov 16 00:49:38 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:49:38 user nova-compute[75826]:     <system>
Nov 16 00:49:38 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:49:38 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:49:38 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:49:38 user nova-compute[75826]:       <entry name="serial">cb8a1a92-10de-4bdc-b730-83bae29ff92b</entry>
Nov 16 00:49:38 user nova-compute[75826]:       <entry name="uuid">cb8a1a92-10de-4bdc-b730-83bae29ff92b</entry>
Nov 16 00:49:38 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:49:38 user nova-compute[75826]:     </system>
Nov 16 00:49:38 user nova-compute[75826]:   </sysinfo>
Nov 16 00:49:38 user nova-compute[75826]:   <os>
Nov 16 00:49:38 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:49:38 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:49:38 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:49:38 user nova-compute[75826]:   </os>
Nov 16 00:49:38 user nova-compute[75826]:   <features>
Nov 16 00:49:38 user nova-compute[75826]:     <acpi/>
Nov 16 00:49:38 user nova-compute[75826]:     <apic/>
Nov 16 00:49:38 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:49:38 user nova-compute[75826]:   </features>
Nov 16 00:49:38 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:49:38 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:49:38 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:49:38 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:49:38 user nova-compute[75826]:   </clock>
Nov 16 00:49:38 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:49:38 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:49:38 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:49:38 user nova-compute[75826]:   </cpu>
Nov 16 00:49:38 user nova-compute[75826]:   <devices>
Nov 16 00:49:38 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:49:38 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:49:38 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk"/>
Nov 16 00:49:38 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:49:38 user nova-compute[75826]:     </disk>
Nov 16 00:49:38 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:49:38 user nova-compute[75826]:       <mac address="fa:16:3e:cc:63:f5"/>
Nov 16 00:49:38 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:49:38 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:49:38 user nova-compute[75826]:       <target dev="tap5c4ad1d8-e2"/>
Nov 16 00:49:38 user nova-compute[75826]:     </interface>
Nov 16 00:49:38 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:49:38 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/console.log" append="off"/>
Nov 16 00:49:38 user nova-compute[75826]:     </serial>
Nov 16 00:49:38 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:49:38 user nova-compute[75826]:     <video>
Nov 16 00:49:38 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:49:38 user nova-compute[75826]:     </video>
Nov 16 00:49:38 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:49:38 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:49:38 user nova-compute[75826]:     </rng>
Nov 16 00:49:38 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:49:38 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:49:38 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:49:38 user nova-compute[75826]:     </memballoon>
Nov 16 00:49:38 user nova-compute[75826]:   </devices>
Nov 16 00:49:38 user nova-compute[75826]: </domain>
Nov 16 00:49:38 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:49:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1266665264',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1266665264',id=30,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkKOKHpjmxVwP9V7adtdz4VQBjXn7APViT1VzpK4o4RhMiapzvLBqHFVkjHnA+c0rjxqezFUAS25kHTzDm+npNVmmZXmRGAI3ibU+T6quMQQhJNAm2BD/LbwCTKFPZM3A==',key_name='tempest-keypair-1217439759',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c770637392a544c48a72c953bfd9e7c6',ramdisk_id='',reservation_id='r-ip881mu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849437325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849437325-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a858d73834524c86a1c5c8514270761e',uuid=cb8a1a92-10de-4bdc-b730-83bae29ff92b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converting VIF {"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG os_vif [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b9e445b-71c7-5490-8e67-1595f3ccb532', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c4ad1d8-e2, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c4ad1d8-e2, col_values=(('qos', UUID('4018b4ec-46e5-46df-bb1d-b125877090c8')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c4ad1d8-e2, col_values=(('external_ids', {'iface-id': '5c4ad1d8-e2df-47a7-9305-538ad370dfba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:63:f5', 'vm-uuid': 'cb8a1a92-10de-4bdc-b730-83bae29ff92b'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:38 user nova-compute[75826]: INFO os_vif [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2')
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:49:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] No VIF found with MAC fa:16:3e:cc:63:f5, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:49:39 user nova-compute[75826]: DEBUG nova.network.neutron [req-4043b43d-3262-4058-b278-bdceb9b6bbe8 req-2df1483e-90bd-4e4d-939f-3de0f979894d service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Updated VIF entry in instance network info cache for port 5c4ad1d8-e2df-47a7-9305-538ad370dfba. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:49:39 user nova-compute[75826]: DEBUG nova.network.neutron [req-4043b43d-3262-4058-b278-bdceb9b6bbe8 req-2df1483e-90bd-4e4d-939f-3de0f979894d service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Updating instance_info_cache with network_info: [{"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:49:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4043b43d-3262-4058-b278-bdceb9b6bbe8 req-2df1483e-90bd-4e4d-939f-3de0f979894d service nova] Releasing lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:49:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-49ac688b-646d-43c2-83b6-9ceb4ca0d1ec req-5e3ffeff-5763-4318-af4d-d096582e1001 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:49:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-49ac688b-646d-43c2-83b6-9ceb4ca0d1ec req-5e3ffeff-5763-4318-af4d-d096582e1001 service nova] Acquiring lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-49ac688b-646d-43c2-83b6-9ceb4ca0d1ec req-5e3ffeff-5763-4318-af4d-d096582e1001 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-49ac688b-646d-43c2-83b6-9ceb4ca0d1ec req-5e3ffeff-5763-4318-af4d-d096582e1001 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-49ac688b-646d-43c2-83b6-9ceb4ca0d1ec req-5e3ffeff-5763-4318-af4d-d096582e1001 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] No waiting events found dispatching network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:49:40 user nova-compute[75826]: WARNING nova.compute.manager [req-49ac688b-646d-43c2-83b6-9ceb4ca0d1ec req-5e3ffeff-5763-4318-af4d-d096582e1001 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received unexpected event network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba for instance with vm_state building and task_state spawning.
Nov 16 00:49:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:49:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:49:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Instance spawned successfully.
Nov 16 00:49:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:49:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:49:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:49:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:49:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:49:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:49:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:49:42 user nova-compute[75826]: INFO nova.compute.manager [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 16 00:49:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:49:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-5d373a35-1e00-466a-9a04-b4f4d6530d7e req-ef53524a-da44-4ab0-a9ac-67e167dd7dd9 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:49:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5d373a35-1e00-466a-9a04-b4f4d6530d7e req-ef53524a-da44-4ab0-a9ac-67e167dd7dd9 service nova] Acquiring lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5d373a35-1e00-466a-9a04-b4f4d6530d7e req-ef53524a-da44-4ab0-a9ac-67e167dd7dd9 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5d373a35-1e00-466a-9a04-b4f4d6530d7e req-ef53524a-da44-4ab0-a9ac-67e167dd7dd9 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-5d373a35-1e00-466a-9a04-b4f4d6530d7e req-ef53524a-da44-4ab0-a9ac-67e167dd7dd9 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] No waiting events found dispatching network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:49:42 user nova-compute[75826]: WARNING nova.compute.manager [req-5d373a35-1e00-466a-9a04-b4f4d6530d7e req-ef53524a-da44-4ab0-a9ac-67e167dd7dd9 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received unexpected event network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba for instance with vm_state building and task_state spawning.
Nov 16 00:49:42 user nova-compute[75826]: INFO nova.compute.manager [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Took 6.65 seconds to build instance.
Nov 16 00:49:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a32f483-3042-40a3-8f70-f52d04b44e3a tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.028s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:46 user nova-compute[75826]: INFO nova.compute.manager [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Rescuing
Nov 16 00:49:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:49:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquired lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:49:46 user nova-compute[75826]: DEBUG nova.network.neutron [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:49:46 user nova-compute[75826]: DEBUG nova.network.neutron [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Updating instance_info_cache with network_info: [{"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:49:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Releasing lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-1e84904b-bb24-47f1-8bf8-8e1d967e8759 req-462be7a8-4e33-4ed0-82ed-cace43b07015 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received event network-vif-unplugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1e84904b-bb24-47f1-8bf8-8e1d967e8759 req-462be7a8-4e33-4ed0-82ed-cace43b07015 service nova] Acquiring lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1e84904b-bb24-47f1-8bf8-8e1d967e8759 req-462be7a8-4e33-4ed0-82ed-cace43b07015 service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1e84904b-bb24-47f1-8bf8-8e1d967e8759 req-462be7a8-4e33-4ed0-82ed-cace43b07015 service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-1e84904b-bb24-47f1-8bf8-8e1d967e8759 req-462be7a8-4e33-4ed0-82ed-cace43b07015 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] No waiting events found dispatching network-vif-unplugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:49:47 user nova-compute[75826]: WARNING nova.compute.manager [req-1e84904b-bb24-47f1-8bf8-8e1d967e8759 req-462be7a8-4e33-4ed0-82ed-cace43b07015 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received unexpected event network-vif-unplugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef for instance with vm_state active and task_state rescuing.
Nov 16 00:49:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Instance destroyed successfully.
Nov 16 00:49:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Attempting rescue
Nov 16 00:49:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75826) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Instance directory exists: not creating {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 00:49:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Creating image(s)
Nov 16 00:49:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "/opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "/opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG nova.objects.instance [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7d7971e0-c96d-4690-8a14-033f6dd35776 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue" returned: 0 in 0.050s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.objects.instance [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'migration_context' on Instance uuid 7d7971e0-c96d-4690-8a14-033f6dd35776 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.objects.base [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<7d7971e0-c96d-4690-8a14-033f6dd35776> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Start _get_guest_xml network_info=[{"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "vif_mac": "fa:16:3e:53:8f:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.objects.instance [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'resources' on Instance uuid 7d7971e0-c96d-4690-8a14-033f6dd35776 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.objects.base [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<7d7971e0-c96d-4690-8a14-033f6dd35776> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.objects.instance [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d7971e0-c96d-4690-8a14-033f6dd35776 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.objects.base [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<7d7971e0-c96d-4690-8a14-033f6dd35776> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:49:48 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:49:48 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.objects.instance [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d7971e0-c96d-4690-8a14-033f6dd35776 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.objects.base [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<7d7971e0-c96d-4690-8a14-033f6dd35776> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:47:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1322313404',display_name='tempest-ServerRescueNegativeTestJSON-server-1322313404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1322313404',id=26,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:48:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c7dc71f0e2f439f9944bd7410db7e08',ramdisk_id='',reservation_id='r-40x83n17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2102246851',owner_user_name='tempest-ServerRescueNegativeTestJSON-2102246851-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:48:04Z,user_data=None,user_id='923da525ba264ea4bf770e3a66319655',uuid=7d7971e0-c96d-4690-8a14-033f6dd35776,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "vif_mac": "fa:16:3e:53:8f:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converting VIF {"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "vif_mac": "fa:16:3e:53:8f:6d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:8f:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5d12fa2-7d94-48c1-a16f-e7330a19ccef,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d12fa2-7d') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.objects.instance [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d7971e0-c96d-4690-8a14-033f6dd35776 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.objects.base [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<7d7971e0-c96d-4690-8a14-033f6dd35776> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:49:48 user nova-compute[75826]:   <uuid>7d7971e0-c96d-4690-8a14-033f6dd35776</uuid>
Nov 16 00:49:48 user nova-compute[75826]:   <name>instance-0000001a</name>
Nov 16 00:49:48 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:49:48 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:49:48 user nova-compute[75826]:   <metadata>
Nov 16 00:49:48 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:49:48 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:49:48 user nova-compute[75826]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1322313404</nova:name>
Nov 16 00:49:48 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:49:48</nova:creationTime>
Nov 16 00:49:48 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:49:48 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:49:48 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:49:48 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:49:48 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:49:48 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:49:48 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:49:48 user nova-compute[75826]:       <nova:owner>
Nov 16 00:49:48 user nova-compute[75826]:         <nova:user uuid="923da525ba264ea4bf770e3a66319655">tempest-ServerRescueNegativeTestJSON-2102246851-project-member</nova:user>
Nov 16 00:49:48 user nova-compute[75826]:         <nova:project uuid="5c7dc71f0e2f439f9944bd7410db7e08">tempest-ServerRescueNegativeTestJSON-2102246851</nova:project>
Nov 16 00:49:48 user nova-compute[75826]:       </nova:owner>
Nov 16 00:49:48 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:49:48 user nova-compute[75826]:       <nova:ports>
Nov 16 00:49:48 user nova-compute[75826]:         <nova:port uuid="f5d12fa2-7d94-48c1-a16f-e7330a19ccef">
Nov 16 00:49:48 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 00:49:48 user nova-compute[75826]:         </nova:port>
Nov 16 00:49:48 user nova-compute[75826]:       </nova:ports>
Nov 16 00:49:48 user nova-compute[75826]:     </nova:instance>
Nov 16 00:49:48 user nova-compute[75826]:   </metadata>
Nov 16 00:49:48 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:49:48 user nova-compute[75826]:     <system>
Nov 16 00:49:48 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:49:48 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:49:48 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:49:48 user nova-compute[75826]:       <entry name="serial">7d7971e0-c96d-4690-8a14-033f6dd35776</entry>
Nov 16 00:49:48 user nova-compute[75826]:       <entry name="uuid">7d7971e0-c96d-4690-8a14-033f6dd35776</entry>
Nov 16 00:49:48 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:49:48 user nova-compute[75826]:     </system>
Nov 16 00:49:48 user nova-compute[75826]:   </sysinfo>
Nov 16 00:49:48 user nova-compute[75826]:   <os>
Nov 16 00:49:48 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:49:48 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:49:48 user nova-compute[75826]:   </os>
Nov 16 00:49:48 user nova-compute[75826]:   <features>
Nov 16 00:49:48 user nova-compute[75826]:     <acpi/>
Nov 16 00:49:48 user nova-compute[75826]:     <apic/>
Nov 16 00:49:48 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:49:48 user nova-compute[75826]:   </features>
Nov 16 00:49:48 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:49:48 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:49:48 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:49:48 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:49:48 user nova-compute[75826]:   </clock>
Nov 16 00:49:48 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:49:48 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:49:48 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:49:48 user nova-compute[75826]:   </cpu>
Nov 16 00:49:48 user nova-compute[75826]:   <devices>
Nov 16 00:49:48 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:49:48 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:49:48 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue"/>
Nov 16 00:49:48 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:49:48 user nova-compute[75826]:     </disk>
Nov 16 00:49:48 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:49:48 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:49:48 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk"/>
Nov 16 00:49:48 user nova-compute[75826]:       <target dev="vdb" bus="virtio"/>
Nov 16 00:49:48 user nova-compute[75826]:     </disk>
Nov 16 00:49:48 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:49:48 user nova-compute[75826]:       <mac address="fa:16:3e:53:8f:6d"/>
Nov 16 00:49:48 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:49:48 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:49:48 user nova-compute[75826]:       <target dev="tapf5d12fa2-7d"/>
Nov 16 00:49:48 user nova-compute[75826]:     </interface>
Nov 16 00:49:48 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:49:48 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/console.log" append="off"/>
Nov 16 00:49:48 user nova-compute[75826]:     </serial>
Nov 16 00:49:48 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:49:48 user nova-compute[75826]:     <video>
Nov 16 00:49:48 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:49:48 user nova-compute[75826]:     </video>
Nov 16 00:49:48 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:49:48 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:49:48 user nova-compute[75826]:     </rng>
Nov 16 00:49:48 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:49:48 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:49:48 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:49:48 user nova-compute[75826]:     </memballoon>
Nov 16 00:49:48 user nova-compute[75826]:   </devices>
Nov 16 00:49:48 user nova-compute[75826]: </domain>
Nov 16 00:49:48 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:49:48 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Instance destroyed successfully.
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No VIF found with MAC fa:16:3e:53:8f:6d, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:49:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-687ac635-3427-46be-9082-efc51695e0c2 req-baf8dfb9-ef59-4534-b984-38712fc3c705 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received event network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:49:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-687ac635-3427-46be-9082-efc51695e0c2 req-baf8dfb9-ef59-4534-b984-38712fc3c705 service nova] Acquiring lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-687ac635-3427-46be-9082-efc51695e0c2 req-baf8dfb9-ef59-4534-b984-38712fc3c705 service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-687ac635-3427-46be-9082-efc51695e0c2 req-baf8dfb9-ef59-4534-b984-38712fc3c705 service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-687ac635-3427-46be-9082-efc51695e0c2 req-baf8dfb9-ef59-4534-b984-38712fc3c705 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] No waiting events found dispatching network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:49:49 user nova-compute[75826]: WARNING nova.compute.manager [req-687ac635-3427-46be-9082-efc51695e0c2 req-baf8dfb9-ef59-4534-b984-38712fc3c705 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received unexpected event network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef for instance with vm_state active and task_state rescuing.
Nov 16 00:49:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-180e4b4d-2252-40ca-a8e0-2bd56ba585c8 req-ace529fd-a60f-4a2d-a556-ad8e0e89cbd8 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received event network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:49:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-180e4b4d-2252-40ca-a8e0-2bd56ba585c8 req-ace529fd-a60f-4a2d-a556-ad8e0e89cbd8 service nova] Acquiring lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-180e4b4d-2252-40ca-a8e0-2bd56ba585c8 req-ace529fd-a60f-4a2d-a556-ad8e0e89cbd8 service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-180e4b4d-2252-40ca-a8e0-2bd56ba585c8 req-ace529fd-a60f-4a2d-a556-ad8e0e89cbd8 service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-180e4b4d-2252-40ca-a8e0-2bd56ba585c8 req-ace529fd-a60f-4a2d-a556-ad8e0e89cbd8 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] No waiting events found dispatching network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:49:51 user nova-compute[75826]: WARNING nova.compute.manager [req-180e4b4d-2252-40ca-a8e0-2bd56ba585c8 req-ace529fd-a60f-4a2d-a556-ad8e0e89cbd8 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received unexpected event network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef for instance with vm_state active and task_state rescuing.
Nov 16 00:49:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-180e4b4d-2252-40ca-a8e0-2bd56ba585c8 req-ace529fd-a60f-4a2d-a556-ad8e0e89cbd8 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received event network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:49:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-180e4b4d-2252-40ca-a8e0-2bd56ba585c8 req-ace529fd-a60f-4a2d-a556-ad8e0e89cbd8 service nova] Acquiring lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:49:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-180e4b4d-2252-40ca-a8e0-2bd56ba585c8 req-ace529fd-a60f-4a2d-a556-ad8e0e89cbd8 service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:49:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-180e4b4d-2252-40ca-a8e0-2bd56ba585c8 req-ace529fd-a60f-4a2d-a556-ad8e0e89cbd8 service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:49:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-180e4b4d-2252-40ca-a8e0-2bd56ba585c8 req-ace529fd-a60f-4a2d-a556-ad8e0e89cbd8 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] No waiting events found dispatching network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:49:51 user nova-compute[75826]: WARNING nova.compute.manager [req-180e4b4d-2252-40ca-a8e0-2bd56ba585c8 req-ace529fd-a60f-4a2d-a556-ad8e0e89cbd8 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received unexpected event network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef for instance with vm_state active and task_state rescuing.
Nov 16 00:49:51 user nova-compute[75826]: DEBUG nova.compute.manager [None req-0b8850e2-32e2-4127-a582-aa1489d8debd tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:49:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:49:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:00 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:50:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:50:01 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:50:01 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 00:50:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:50:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-900b4c5d-7db9-416b-af9d-dca6134b12a6 req-ed1fd451-0521-4677-aa3a-ff0bb7ed13ec service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received event network-changed-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-900b4c5d-7db9-416b-af9d-dca6134b12a6 req-ed1fd451-0521-4677-aa3a-ff0bb7ed13ec service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Refreshing instance network info cache due to event network-changed-aa2e60a2-3b7d-4532-82ff-49b9f83bc648. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-900b4c5d-7db9-416b-af9d-dca6134b12a6 req-ed1fd451-0521-4677-aa3a-ff0bb7ed13ec service nova] Acquiring lock "refresh_cache-5e4641de-b527-49ae-aea0-1821c759f9a4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-900b4c5d-7db9-416b-af9d-dca6134b12a6 req-ed1fd451-0521-4677-aa3a-ff0bb7ed13ec service nova] Acquired lock "refresh_cache-5e4641de-b527-49ae-aea0-1821c759f9a4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG nova.network.neutron [req-900b4c5d-7db9-416b-af9d-dca6134b12a6 req-ed1fd451-0521-4677-aa3a-ff0bb7ed13ec service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Refreshing network info cache for port aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG nova.network.neutron [req-900b4c5d-7db9-416b-af9d-dca6134b12a6 req-ed1fd451-0521-4677-aa3a-ff0bb7ed13ec service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Updated VIF entry in instance network info cache for port aa2e60a2-3b7d-4532-82ff-49b9f83bc648. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG nova.network.neutron [req-900b4c5d-7db9-416b-af9d-dca6134b12a6 req-ed1fd451-0521-4677-aa3a-ff0bb7ed13ec service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Updating instance_info_cache with network_info: [{"id": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "address": "fa:16:3e:7a:57:14", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2e60a2-3b", "ovs_interfaceid": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-900b4c5d-7db9-416b-af9d-dca6134b12a6 req-ed1fd451-0521-4677-aa3a-ff0bb7ed13ec service nova] Releasing lock "refresh_cache-5e4641de-b527-49ae-aea0-1821c759f9a4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG nova.objects.instance [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lazy-loading 'flavor' on Instance uuid 5e4641de-b527-49ae-aea0-1821c759f9a4 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:50:06 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Ignoring supplied device name: /dev/vdb
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:06 user nova-compute[75826]: INFO nova.compute.manager [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Attaching volume dbc03b2e-e097-48dd-94b8-bb0dcd2e172a to /dev/vdb
Nov 16 00:50:06 user nova-compute[75826]: DEBUG os_brick.utils [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb2f7c81-5853-4e9f-8e4c-274b1a1ab52f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a001faa4-14d0-481d-a7a7-503a806c420b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[629d8aca-0399-4c28-926e-e1579384130e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fb8bed-809b-4a1a-8997-bbddb1d1cd2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:07 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:50:07 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7472MB free_disk=25.199188232421875GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:50:07 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:50:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db3323a-2fd6-4ef1-824e-47f7d907b5c3]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG os_brick.utils [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] <== get_connector_properties: return (495ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Updating existing volume attachment record: 5bf84cd4-9fe7-44b4-9f9d-1861bd0dbe68 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 298c8986-b91b-4f46-bcce-75e28bc02b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 87b2703e-0154-445e-b659-5f5cf1d9f8f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 5e4641de-b527-49ae-aea0-1821c759f9a4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13857dd8-0db8-4a60-ad86-36c8c295fc6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance cc77d9aa-4052-40dd-9495-3a516d8f0793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance cb8a1a92-10de-4bdc-b730-83bae29ff92b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing inventories for resource provider 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating ProviderTree inventory for provider 015246d3-5250-41ea-8943-b837ba3f5938 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating inventory in ProviderTree for provider 015246d3-5250-41ea-8943-b837ba3f5938 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing aggregate associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, aggregates: None {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 00:50:07 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing trait associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 00:50:08 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:50:08 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:50:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:50:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.741s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:08 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:50:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:10 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:50:10 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:50:10 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:50:10 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:50:10 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:50:10 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:50:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:50:11 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 00:50:11 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] There are 0 instances to clean {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 00:50:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:50:11 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75826) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdebNaRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:50:12 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:50:12 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:50:12 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ecc957-202f-4545-b941-a0c25dd555a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:50:12 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d0df85-66ba-4fc4-a46f-6e24cdf1c2ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a] added
Nov 16 00:50:12 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5710c4dc-7195-446f-b77c-ce6c33bfe448]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c522834a-b56a-454d-bdcb-a0bea7e143b5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdebNaRV {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IdebNaRV" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc4ecff-e5ce-4275-b960-e3a5dc84c834]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IdebNaRV'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8e9a88-452f-4125-96fb-529df2969660]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[64468de1-9cbb-4793-8e37-c540963bb88a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:12 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:12 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:12 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:12 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c2b8b1-59bf-48ea-a76e-33af8f89dc93]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a, portal: 172.16.0.220,3260]
Nov 16 00:50:12 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a, portal: 172.16.0.220,3260] successful.
Nov 16 00:50:12 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[244a2124-6a63-47fe-a476-0ed462799de8]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[46640065-f846-40cd-9bcc-fe348da44f20]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:12 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:12 user nova-compute[75826]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)
Nov 16 00:50:12 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:12 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:12 user nova-compute[75826]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)
Nov 16 00:50:12 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[013016ca-c143-4a8e-804a-971dba04dd83]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:12 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:50:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:50:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdebNaRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:50:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:50:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] <== connect_volume: return (1312ms) {'type': 'block', 'scsi_wwn': '26537623430336633', 'path': '/dev/sdd'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:50:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26537623430336633', 'path': '/dev/sdd'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:50:13 user nova-compute[75826]: DEBUG nova.objects.instance [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lazy-loading 'flavor' on Instance uuid 5e4641de-b527-49ae-aea0-1821c759f9a4 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:50:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:50:13 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:50:13 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 00:50:13 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:50:13 user nova-compute[75826]:   <serial>dbc03b2e-e097-48dd-94b8-bb0dcd2e172a</serial>
Nov 16 00:50:13 user nova-compute[75826]: </disk>
Nov 16 00:50:13 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:50:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:50:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:50:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] No VIF found with MAC fa:16:3e:7a:57:14, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:50:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ccf96e16-8513-4056-980d-a9baa8e08d2c tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.330s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-a4acde29-0f53-461a-b7c1-0dd19d90851a req-5385169c-81b9-4020-bbde-57403f326b5c service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Received event network-changed-10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-a4acde29-0f53-461a-b7c1-0dd19d90851a req-5385169c-81b9-4020-bbde-57403f326b5c service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Refreshing instance network info cache due to event network-changed-10e28ff4-7e94-41c1-aff1-0da319029625. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:50:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a4acde29-0f53-461a-b7c1-0dd19d90851a req-5385169c-81b9-4020-bbde-57403f326b5c service nova] Acquiring lock "refresh_cache-13857dd8-0db8-4a60-ad86-36c8c295fc6e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:50:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a4acde29-0f53-461a-b7c1-0dd19d90851a req-5385169c-81b9-4020-bbde-57403f326b5c service nova] Acquired lock "refresh_cache-13857dd8-0db8-4a60-ad86-36c8c295fc6e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:50:14 user nova-compute[75826]: DEBUG nova.network.neutron [req-a4acde29-0f53-461a-b7c1-0dd19d90851a req-5385169c-81b9-4020-bbde-57403f326b5c service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Refreshing network info cache for port 10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:15 user nova-compute[75826]: INFO nova.compute.manager [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Terminating instance
Nov 16 00:50:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG nova.network.neutron [req-a4acde29-0f53-461a-b7c1-0dd19d90851a req-5385169c-81b9-4020-bbde-57403f326b5c service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Updated VIF entry in instance network info cache for port 10e28ff4-7e94-41c1-aff1-0da319029625. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG nova.network.neutron [req-a4acde29-0f53-461a-b7c1-0dd19d90851a req-5385169c-81b9-4020-bbde-57403f326b5c service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Updating instance_info_cache with network_info: [{"id": "10e28ff4-7e94-41c1-aff1-0da319029625", "address": "fa:16:3e:df:db:96", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e28ff4-7e", "ovs_interfaceid": "10e28ff4-7e94-41c1-aff1-0da319029625", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a4acde29-0f53-461a-b7c1-0dd19d90851a req-5385169c-81b9-4020-bbde-57403f326b5c service nova] Releasing lock "refresh_cache-13857dd8-0db8-4a60-ad86-36c8c295fc6e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-b41e32c6-e977-4857-a1f3-97a5c70f891b req-a65a228e-449c-498e-8a35-f2a0816a2f40 service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Received event network-vif-unplugged-10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b41e32c6-e977-4857-a1f3-97a5c70f891b req-a65a228e-449c-498e-8a35-f2a0816a2f40 service nova] Acquiring lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b41e32c6-e977-4857-a1f3-97a5c70f891b req-a65a228e-449c-498e-8a35-f2a0816a2f40 service nova] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b41e32c6-e977-4857-a1f3-97a5c70f891b req-a65a228e-449c-498e-8a35-f2a0816a2f40 service nova] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-b41e32c6-e977-4857-a1f3-97a5c70f891b req-a65a228e-449c-498e-8a35-f2a0816a2f40 service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] No waiting events found dispatching network-vif-unplugged-10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-b41e32c6-e977-4857-a1f3-97a5c70f891b req-a65a228e-449c-498e-8a35-f2a0816a2f40 service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Received event network-vif-unplugged-10e28ff4-7e94-41c1-aff1-0da319029625 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:50:15 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Instance destroyed successfully.
Nov 16 00:50:15 user nova-compute[75826]: DEBUG nova.objects.instance [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'resources' on Instance uuid 13857dd8-0db8-4a60-ad86-36c8c295fc6e {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:48:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-784657056',display_name='tempest-AttachVolumeNegativeTest-server-784657056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-784657056',id=28,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBVKkX36k0SgNST5x5wkvrF9nYJe5UCzKG+ApKxzJdsTXgeTjNNeJSkYEwMmt0vUNOsoHzZ1JlsYfxZUOnKgsme1XeIlUx9/WofsZyLxLtJuJnMf7+HIpvvgRD8KtFgGiw==',key_name='tempest-keypair-1180291907',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:48:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13ad3ee3a8e04d728243e886a1460cae',ramdisk_id='',reservation_id='r-2f1jz8m8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-471555798',owner_user_name='tempest-AttachVolumeNegativeTest-471555798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:48:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e2d1a7cea414446842b5abfc9fe93de',uuid=13857dd8-0db8-4a60-ad86-36c8c295fc6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10e28ff4-7e94-41c1-aff1-0da319029625", "address": "fa:16:3e:df:db:96", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e28ff4-7e", "ovs_interfaceid": "10e28ff4-7e94-41c1-aff1-0da319029625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converting VIF {"id": "10e28ff4-7e94-41c1-aff1-0da319029625", "address": "fa:16:3e:df:db:96", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10e28ff4-7e", "ovs_interfaceid": "10e28ff4-7e94-41c1-aff1-0da319029625", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:db:96,bridge_name='br-int',has_traffic_filtering=True,id=10e28ff4-7e94-41c1-aff1-0da319029625,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e28ff4-7e') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG os_vif [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:db:96,bridge_name='br-int',has_traffic_filtering=True,id=10e28ff4-7e94-41c1-aff1-0da319029625,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e28ff4-7e') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10e28ff4-7e, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0af8482b-1210-4d26-80fe-3a2ccca6c87c) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:50:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:15 user nova-compute[75826]: INFO os_vif [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:db:96,bridge_name='br-int',has_traffic_filtering=True,id=10e28ff4-7e94-41c1-aff1-0da319029625,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10e28ff4-7e')
Nov 16 00:50:15 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Deleting instance files /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e_del
Nov 16 00:50:15 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Deletion of /opt/stack/data/nova/instances/13857dd8-0db8-4a60-ad86-36c8c295fc6e_del complete
Nov 16 00:50:16 user nova-compute[75826]: INFO nova.compute.manager [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 16 00:50:16 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:50:16 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:50:16 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:50:16 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:50:16 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Took 0.74 seconds to deallocate network for instance.
Nov 16 00:50:16 user nova-compute[75826]: DEBUG nova.compute.manager [req-38de514c-3f13-4bfe-a37e-3f58e2256395 req-ee2b2d14-b382-4e8d-a935-67a82be46d5b service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Received event network-vif-deleted-10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:16 user nova-compute[75826]: INFO nova.compute.manager [req-38de514c-3f13-4bfe-a37e-3f58e2256395 req-ee2b2d14-b382-4e8d-a935-67a82be46d5b service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Neutron deleted interface 10e28ff4-7e94-41c1-aff1-0da319029625; detaching it from the instance and deleting it from the info cache
Nov 16 00:50:16 user nova-compute[75826]: DEBUG nova.network.neutron [req-38de514c-3f13-4bfe-a37e-3f58e2256395 req-ee2b2d14-b382-4e8d-a935-67a82be46d5b service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:50:16 user nova-compute[75826]: DEBUG nova.compute.manager [req-38de514c-3f13-4bfe-a37e-3f58e2256395 req-ee2b2d14-b382-4e8d-a935-67a82be46d5b service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Detach interface failed, port_id=10e28ff4-7e94-41c1-aff1-0da319029625, reason: Instance 13857dd8-0db8-4a60-ad86-36c8c295fc6e could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:50:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:17 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:50:17 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:50:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-7817dad0-04bf-4a2c-8bd7-4dd91edde96a req-d5ffeb22-509a-409b-b308-437bdae2ac58 service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Received event network-vif-plugged-10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7817dad0-04bf-4a2c-8bd7-4dd91edde96a req-d5ffeb22-509a-409b-b308-437bdae2ac58 service nova] Acquiring lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7817dad0-04bf-4a2c-8bd7-4dd91edde96a req-d5ffeb22-509a-409b-b308-437bdae2ac58 service nova] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7817dad0-04bf-4a2c-8bd7-4dd91edde96a req-d5ffeb22-509a-409b-b308-437bdae2ac58 service nova] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-7817dad0-04bf-4a2c-8bd7-4dd91edde96a req-d5ffeb22-509a-409b-b308-437bdae2ac58 service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] No waiting events found dispatching network-vif-plugged-10e28ff4-7e94-41c1-aff1-0da319029625 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:17 user nova-compute[75826]: WARNING nova.compute.manager [req-7817dad0-04bf-4a2c-8bd7-4dd91edde96a req-d5ffeb22-509a-409b-b308-437bdae2ac58 service nova] [instance: 13857dd8-0db8-4a60-ad86-36c8c295fc6e] Received unexpected event network-vif-plugged-10e28ff4-7e94-41c1-aff1-0da319029625 for instance with vm_state deleted and task_state None.
Nov 16 00:50:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.807s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:17 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Deleted allocations for instance 13857dd8-0db8-4a60-ad86-36c8c295fc6e
Nov 16 00:50:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-db4a7985-8f0b-411f-961f-c138350879c3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "13857dd8-0db8-4a60-ad86-36c8c295fc6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.667s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:30 user nova-compute[75826]: INFO nova.compute.manager [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Detaching volume dbc03b2e-e097-48dd-94b8-bb0dcd2e172a
Nov 16 00:50:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:30 user nova-compute[75826]: INFO nova.virt.block_device [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Attempting to driver detach volume dbc03b2e-e097-48dd-94b8-bb0dcd2e172a from mountpoint /dev/vdb
Nov 16 00:50:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Attempting to detach device vdb from instance 5e4641de-b527-49ae-aea0-1821c759f9a4 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:50:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:50:30 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:50:30 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 00:50:30 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:50:30 user nova-compute[75826]:   <serial>dbc03b2e-e097-48dd-94b8-bb0dcd2e172a</serial>
Nov 16 00:50:30 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:50:30 user nova-compute[75826]: </disk>
Nov 16 00:50:30 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:50:30 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Successfully detached device vdb from instance 5e4641de-b527-49ae-aea0-1821c759f9a4 from the persistent domain config.
Nov 16 00:50:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5e4641de-b527-49ae-aea0-1821c759f9a4 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:50:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:50:30 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:50:30 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 00:50:30 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:50:30 user nova-compute[75826]:   <serial>dbc03b2e-e097-48dd-94b8-bb0dcd2e172a</serial>
Nov 16 00:50:30 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:50:30 user nova-compute[75826]: </disk>
Nov 16 00:50:30 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "38a96872-51b5-448d-83c8-f722520d128c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:50:31 user nova-compute[75826]: INFO nova.compute.claims [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Claim successful on node user
Nov 16 00:50:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5e4641de-b527-49ae-aea0-1821c759f9a4 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:50:31 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:50:31 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG nova.policy [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '055179a465cc4327b4ce68af5018608c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d0d81c4b6d0415681092d61ea35de51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:50:31 user nova-compute[75826]: INFO nova.virt.block_device [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Booting with volume deaf5ba5-af12-408d-9a62-d905764b73e9 at /dev/vda
Nov 16 00:50:31 user nova-compute[75826]: DEBUG os_brick.utils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a658d3-c842-4310-86df-c99ad17708dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0cb6d9-672d-46a3-8ce6-78140c92eb35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[348d506f-bd80-488c-895d-babfe6a01077]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb487c62-e3ce-4ccd-9923-847d811fb134]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:50:31 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:50:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[087e9893-7e47-472c-b75b-88deda29b774]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG os_brick.utils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:50:31 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Updating existing volume attachment record: aac98a53-c24f-4f35-9fb3-faf281a19ffd {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:50:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:32 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Successfully created port: 5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:50:33 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Successfully updated port: 5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:50:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:50:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquired lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:50:33 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:50:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-80a85354-a483-4855-b422-5a2bbe62f67f req-99f2b32c-dfd3-4f78-aa4a-8af37d37601f service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received event network-changed-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-80a85354-a483-4855-b422-5a2bbe62f67f req-99f2b32c-dfd3-4f78-aa4a-8af37d37601f service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Refreshing instance network info cache due to event network-changed-5aaa7f08-f7a2-4933-9667-b6e444930366. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:50:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-80a85354-a483-4855-b422-5a2bbe62f67f req-99f2b32c-dfd3-4f78-aa4a-8af37d37601f service nova] Acquiring lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:50:33 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:50:34 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Updating instance_info_cache with network_info: [{"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:50:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Releasing lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:50:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Instance network_info: |[{"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:50:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-80a85354-a483-4855-b422-5a2bbe62f67f req-99f2b32c-dfd3-4f78-aa4a-8af37d37601f service nova] Acquired lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:50:34 user nova-compute[75826]: DEBUG nova.network.neutron [req-80a85354-a483-4855-b422-5a2bbe62f67f req-99f2b32c-dfd3-4f78-aa4a-8af37d37601f service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Refreshing network info cache for port 5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:50:34 user nova-compute[75826]: DEBUG nova.network.neutron [req-80a85354-a483-4855-b422-5a2bbe62f67f req-99f2b32c-dfd3-4f78-aa4a-8af37d37601f service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Updated VIF entry in instance network info cache for port 5aaa7f08-f7a2-4933-9667-b6e444930366. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:50:34 user nova-compute[75826]: DEBUG nova.network.neutron [req-80a85354-a483-4855-b422-5a2bbe62f67f req-99f2b32c-dfd3-4f78-aa4a-8af37d37601f service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Updating instance_info_cache with network_info: [{"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:50:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-80a85354-a483-4855-b422-5a2bbe62f67f req-99f2b32c-dfd3-4f78-aa4a-8af37d37601f service nova] Releasing lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:50:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:50:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Creating image(s)
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Ensure instance console log exists: /opt/stack/data/nova/instances/38a96872-51b5-448d-83c8-f722520d128c/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Start _get_guest_xml network_info=[{"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'aac98a53-c24f-4f35-9fb3-faf281a19ffd', 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GoJBRfEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '38a96872-51b5-448d-83c8-f722520d128c', 'attached_at': '', 'detached_at': '', 'volume_id': 'deaf5ba5-af12-408d-9a62-d905764b73e9', 'serial': 'deaf5ba5-af12-408d-9a62-d905764b73e9'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:50:37 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:50:37 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GoJBRfEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:50:37 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:50:37 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:50:37 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b47156-b531-4fc9-a69c-542fe2ba4445]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:50:37 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc584017-e450-4fcc-890d-e3d8218b95d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9] added
Nov 16 00:50:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[81905c2c-fd84-48fd-b119-4f970f12eec9]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1364c41-7347-4a8c-9822-78ddae46aa91]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GoJBRfEa {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GoJBRfEa" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[365f330c-3761-40f6-a45b-b45ed181e54f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GoJBRfEa'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda7b842-4826-4f6e-bbbb-ab2928be8d71]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ad606f-efe6-4350-ac9d-be676f1a761c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:37 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:37 user nova-compute[75826]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)
Nov 16 00:50:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:37 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:37 user nova-compute[75826]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)
Nov 16 00:50:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[139d367d-930d-4c17-b26d-3339639367ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260]
Nov 16 00:50:37 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260] successful.
Nov 16 00:50:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e61506-87fb-4e31-a773-0eeeab66868e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[71860abe-e2b8-4ae4-a967-f78f2f6e5101]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:37 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:37 user nova-compute[75826]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)
Nov 16 00:50:37 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:50:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:37 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:37 user nova-compute[75826]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)
Nov 16 00:50:37 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:50:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[64abe8ad-9235-4b01-8031-54bee6977fc1]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:50:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GoJBRfEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26235633565663763', 'path': '/dev/sde'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235633565663763', 'path': '/dev/sde'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:50:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1176128372',display_name='tempest-ServerActionsTestOtherA-server-1176128372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1176128372',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcHp4MQ1nmnfoZHtG9WUM26rOqXSqM447yKb3OZbHurSNdmdHJlgSIOlTsu4HAYreZ++oluuNxFq/KteFOdGXtyepeTckkePgfQai5TpDlxusLQNPtiszvnX3ROIIcIMw==',key_name='tempest-keypair-2013094512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-spmosdih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:50:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=38a96872-51b5-448d-83c8-f722520d128c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lazy-loading 'pci_devices' on Instance uuid 38a96872-51b5-448d-83c8-f722520d128c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:50:38 user nova-compute[75826]:   <uuid>38a96872-51b5-448d-83c8-f722520d128c</uuid>
Nov 16 00:50:38 user nova-compute[75826]:   <name>instance-0000001f</name>
Nov 16 00:50:38 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:50:38 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:50:38 user nova-compute[75826]:   <metadata>
Nov 16 00:50:38 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:50:38 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:50:38 user nova-compute[75826]:       <nova:name>tempest-ServerActionsTestOtherA-server-1176128372</nova:name>
Nov 16 00:50:38 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:50:37</nova:creationTime>
Nov 16 00:50:38 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:50:38 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:50:38 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:50:38 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:50:38 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:50:38 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:50:38 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:50:38 user nova-compute[75826]:       <nova:owner>
Nov 16 00:50:38 user nova-compute[75826]:         <nova:user uuid="055179a465cc4327b4ce68af5018608c">tempest-ServerActionsTestOtherA-329506797-project-member</nova:user>
Nov 16 00:50:38 user nova-compute[75826]:         <nova:project uuid="4d0d81c4b6d0415681092d61ea35de51">tempest-ServerActionsTestOtherA-329506797</nova:project>
Nov 16 00:50:38 user nova-compute[75826]:       </nova:owner>
Nov 16 00:50:38 user nova-compute[75826]:       <nova:ports>
Nov 16 00:50:38 user nova-compute[75826]:         <nova:port uuid="5aaa7f08-f7a2-4933-9667-b6e444930366">
Nov 16 00:50:38 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:50:38 user nova-compute[75826]:         </nova:port>
Nov 16 00:50:38 user nova-compute[75826]:       </nova:ports>
Nov 16 00:50:38 user nova-compute[75826]:     </nova:instance>
Nov 16 00:50:38 user nova-compute[75826]:   </metadata>
Nov 16 00:50:38 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:50:38 user nova-compute[75826]:     <system>
Nov 16 00:50:38 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:50:38 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:50:38 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:50:38 user nova-compute[75826]:       <entry name="serial">38a96872-51b5-448d-83c8-f722520d128c</entry>
Nov 16 00:50:38 user nova-compute[75826]:       <entry name="uuid">38a96872-51b5-448d-83c8-f722520d128c</entry>
Nov 16 00:50:38 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:50:38 user nova-compute[75826]:     </system>
Nov 16 00:50:38 user nova-compute[75826]:   </sysinfo>
Nov 16 00:50:38 user nova-compute[75826]:   <os>
Nov 16 00:50:38 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:50:38 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:50:38 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:50:38 user nova-compute[75826]:   </os>
Nov 16 00:50:38 user nova-compute[75826]:   <features>
Nov 16 00:50:38 user nova-compute[75826]:     <acpi/>
Nov 16 00:50:38 user nova-compute[75826]:     <apic/>
Nov 16 00:50:38 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:50:38 user nova-compute[75826]:   </features>
Nov 16 00:50:38 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:50:38 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:50:38 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:50:38 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:50:38 user nova-compute[75826]:   </clock>
Nov 16 00:50:38 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:50:38 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:50:38 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:50:38 user nova-compute[75826]:   </cpu>
Nov 16 00:50:38 user nova-compute[75826]:   <devices>
Nov 16 00:50:38 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:50:38 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:50:38 user nova-compute[75826]:       <source dev="/dev/sde"/>
Nov 16 00:50:38 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:50:38 user nova-compute[75826]:       <serial>deaf5ba5-af12-408d-9a62-d905764b73e9</serial>
Nov 16 00:50:38 user nova-compute[75826]:     </disk>
Nov 16 00:50:38 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:50:38 user nova-compute[75826]:       <mac address="fa:16:3e:05:7b:62"/>
Nov 16 00:50:38 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:50:38 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:50:38 user nova-compute[75826]:       <target dev="tap5aaa7f08-f7"/>
Nov 16 00:50:38 user nova-compute[75826]:     </interface>
Nov 16 00:50:38 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:50:38 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/38a96872-51b5-448d-83c8-f722520d128c/console.log" append="off"/>
Nov 16 00:50:38 user nova-compute[75826]:     </serial>
Nov 16 00:50:38 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:50:38 user nova-compute[75826]:     <video>
Nov 16 00:50:38 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:50:38 user nova-compute[75826]:     </video>
Nov 16 00:50:38 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:50:38 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:50:38 user nova-compute[75826]:     </rng>
Nov 16 00:50:38 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:50:38 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:50:38 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:50:38 user nova-compute[75826]:     </memballoon>
Nov 16 00:50:38 user nova-compute[75826]:   </devices>
Nov 16 00:50:38 user nova-compute[75826]: </domain>
Nov 16 00:50:38 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:50:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1176128372',display_name='tempest-ServerActionsTestOtherA-server-1176128372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1176128372',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcHp4MQ1nmnfoZHtG9WUM26rOqXSqM447yKb3OZbHurSNdmdHJlgSIOlTsu4HAYreZ++oluuNxFq/KteFOdGXtyepeTckkePgfQai5TpDlxusLQNPtiszvnX3ROIIcIMw==',key_name='tempest-keypair-2013094512',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-spmosdih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:50:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=38a96872-51b5-448d-83c8-f722520d128c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG os_vif [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60a811d5-893c-523a-a53b-6bf1c3330974', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5aaa7f08-f7, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5aaa7f08-f7, col_values=(('qos', UUID('e8a11ea6-9056-4be3-baaf-b075ff8a9546')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5aaa7f08-f7, col_values=(('external_ids', {'iface-id': '5aaa7f08-f7a2-4933-9667-b6e444930366', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:7b:62', 'vm-uuid': '38a96872-51b5-448d-83c8-f722520d128c'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:50:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:38 user nova-compute[75826]: INFO os_vif [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7')
Nov 16 00:50:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:50:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No VIF found with MAC fa:16:3e:05:7b:62, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:50:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "34bed458-5248-473d-b022-7f953669d85c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:50:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:39 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:50:39 user nova-compute[75826]: INFO nova.compute.claims [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Claim successful on node user
Nov 16 00:50:39 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:50:39 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:50:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.473s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:50:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:50:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:50:39 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:50:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:50:40 user nova-compute[75826]: INFO nova.virt.block_device [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Booting with volume-backed-image 61385222-0f31-4bd2-a3f7-ab482e7050c4 at /dev/vda
Nov 16 00:50:40 user nova-compute[75826]: DEBUG nova.policy [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f8606321461c403cbec7f0a36e454bc8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e45c7fd936b74e109f83fc69060af216', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:50:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-8df09315-0534-4c3e-93a7-ea1d879cba02 req-f46a0a03-2de9-4bc1-835b-442aa94959c6 service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received event network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8df09315-0534-4c3e-93a7-ea1d879cba02 req-f46a0a03-2de9-4bc1-835b-442aa94959c6 service nova] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8df09315-0534-4c3e-93a7-ea1d879cba02 req-f46a0a03-2de9-4bc1-835b-442aa94959c6 service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8df09315-0534-4c3e-93a7-ea1d879cba02 req-f46a0a03-2de9-4bc1-835b-442aa94959c6 service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-8df09315-0534-4c3e-93a7-ea1d879cba02 req-f46a0a03-2de9-4bc1-835b-442aa94959c6 service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] No waiting events found dispatching network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:40 user nova-compute[75826]: WARNING nova.compute.manager [req-8df09315-0534-4c3e-93a7-ea1d879cba02 req-f46a0a03-2de9-4bc1-835b-442aa94959c6 service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received unexpected event network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 for instance with vm_state building and task_state spawning.
Nov 16 00:50:40 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Successfully created port: edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:50:41 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Successfully updated port: edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:50:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "refresh_cache-34bed458-5248-473d-b022-7f953669d85c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:50:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquired lock "refresh_cache-34bed458-5248-473d-b022-7f953669d85c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:50:41 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:50:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-249f4d70-5279-4193-82a0-6b4cf60658a0 req-a6f7165c-49c7-4930-a6ad-02141a50705b service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-changed-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-249f4d70-5279-4193-82a0-6b4cf60658a0 req-a6f7165c-49c7-4930-a6ad-02141a50705b service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Refreshing instance network info cache due to event network-changed-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:50:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-249f4d70-5279-4193-82a0-6b4cf60658a0 req-a6f7165c-49c7-4930-a6ad-02141a50705b service nova] Acquiring lock "refresh_cache-34bed458-5248-473d-b022-7f953669d85c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:50:41 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:50:41 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Updating instance_info_cache with network_info: [{"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:50:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Releasing lock "refresh_cache-34bed458-5248-473d-b022-7f953669d85c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:50:41 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Instance network_info: |[{"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:50:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-249f4d70-5279-4193-82a0-6b4cf60658a0 req-a6f7165c-49c7-4930-a6ad-02141a50705b service nova] Acquired lock "refresh_cache-34bed458-5248-473d-b022-7f953669d85c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:50:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-249f4d70-5279-4193-82a0-6b4cf60658a0 req-a6f7165c-49c7-4930-a6ad-02141a50705b service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Refreshing network info cache for port edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.network.neutron [req-249f4d70-5279-4193-82a0-6b4cf60658a0 req-a6f7165c-49c7-4930-a6ad-02141a50705b service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Updated VIF entry in instance network info cache for port edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.network.neutron [req-249f4d70-5279-4193-82a0-6b4cf60658a0 req-a6f7165c-49c7-4930-a6ad-02141a50705b service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Updating instance_info_cache with network_info: [{"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-249f4d70-5279-4193-82a0-6b4cf60658a0 req-a6f7165c-49c7-4930-a6ad-02141a50705b service nova] Releasing lock "refresh_cache-34bed458-5248-473d-b022-7f953669d85c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:50:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Instance spawned successfully.
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:42 user nova-compute[75826]: INFO nova.compute.manager [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Took 5.30 seconds to spawn the instance on the hypervisor.
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-080950e4-fa36-4032-9ad6-83c315ff1581 req-4417a18a-aa4d-4519-819e-bbe5d45f7045 service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received event network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-080950e4-fa36-4032-9ad6-83c315ff1581 req-4417a18a-aa4d-4519-819e-bbe5d45f7045 service nova] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-080950e4-fa36-4032-9ad6-83c315ff1581 req-4417a18a-aa4d-4519-819e-bbe5d45f7045 service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-080950e4-fa36-4032-9ad6-83c315ff1581 req-4417a18a-aa4d-4519-819e-bbe5d45f7045 service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-080950e4-fa36-4032-9ad6-83c315ff1581 req-4417a18a-aa4d-4519-819e-bbe5d45f7045 service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] No waiting events found dispatching network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:42 user nova-compute[75826]: WARNING nova.compute.manager [req-080950e4-fa36-4032-9ad6-83c315ff1581 req-4417a18a-aa4d-4519-819e-bbe5d45f7045 service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received unexpected event network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 for instance with vm_state building and task_state spawning.
Nov 16 00:50:42 user nova-compute[75826]: INFO nova.compute.manager [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Took 11.70 seconds to build instance.
Nov 16 00:50:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f6b4c73-876a-4a4a-b824-cf49c85bdd82 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "38a96872-51b5-448d-83c8-f722520d128c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.833s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG os_brick.utils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87a4d76-8889-4c67-a2ea-2c43a69cc33c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40957cb-53a9-4b5f-a5d7-63d40ba34057]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf98df7-f6bd-4332-8c7c-1d6842a5c91c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cc906a-ad66-4eab-bed9-978195280a46]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:50:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:50:46 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:50:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d7bc15-eeda-4186-a80b-a42448c0d23d]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG os_brick.utils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Updating existing volume attachment record: 2edfc124-5c6d-4acc-999d-fdaf5c87365e {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:50:46 user nova-compute[75826]: INFO nova.compute.claims [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Claim successful on node user
Nov 16 00:50:46 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:50:46 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:50:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:50:47 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG nova.policy [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd7ea010b69874f3eb8947e93531e6669', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '328112cf55d04d8c8bb1b9d5655a2115', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:50:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Creating image(s)
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "/opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "/opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "/opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.239s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.218s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk 1073741824" returned: 0 in 0.083s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Successfully created port: 7b89ef46-36c9-467e-8452-1f9033c3b5b9 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.215s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:50:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Cannot resize image /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Ensure instance console log exists: /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Successfully updated port: 7b89ef46-36c9-467e-8452-1f9033c3b5b9 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "refresh_cache-1a8d5a29-7f30-4c80-8e49-32081a514b2c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquired lock "refresh_cache-1a8d5a29-7f30-4c80-8e49-32081a514b2c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-105b05e1-7448-429d-a400-d1b8dbf62277 req-fa7dd3c9-02be-4aa1-b2b1-cceec552dac1 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Received event network-changed-7b89ef46-36c9-467e-8452-1f9033c3b5b9 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-105b05e1-7448-429d-a400-d1b8dbf62277 req-fa7dd3c9-02be-4aa1-b2b1-cceec552dac1 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Refreshing instance network info cache due to event network-changed-7b89ef46-36c9-467e-8452-1f9033c3b5b9. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-105b05e1-7448-429d-a400-d1b8dbf62277 req-fa7dd3c9-02be-4aa1-b2b1-cceec552dac1 service nova] Acquiring lock "refresh_cache-1a8d5a29-7f30-4c80-8e49-32081a514b2c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Updating instance_info_cache with network_info: [{"id": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "address": "fa:16:3e:e7:2e:6c", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b89ef46-36", "ovs_interfaceid": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Releasing lock "refresh_cache-1a8d5a29-7f30-4c80-8e49-32081a514b2c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Instance network_info: |[{"id": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "address": "fa:16:3e:e7:2e:6c", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b89ef46-36", "ovs_interfaceid": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-105b05e1-7448-429d-a400-d1b8dbf62277 req-fa7dd3c9-02be-4aa1-b2b1-cceec552dac1 service nova] Acquired lock "refresh_cache-1a8d5a29-7f30-4c80-8e49-32081a514b2c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-105b05e1-7448-429d-a400-d1b8dbf62277 req-fa7dd3c9-02be-4aa1-b2b1-cceec552dac1 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Refreshing network info cache for port 7b89ef46-36c9-467e-8452-1f9033c3b5b9 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Start _get_guest_xml network_info=[{"id": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "address": "fa:16:3e:e7:2e:6c", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b89ef46-36", "ovs_interfaceid": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:50:48 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:50:48 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-269779050',display_name='tempest-ServersNegativeTestJSON-server-269779050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-269779050',id=33,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='328112cf55d04d8c8bb1b9d5655a2115',ramdisk_id='',reservation_id='r-rrgvs0mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1135241657',owner_user_name='tempest-ServersNegativeTestJSON-1135241657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:50:47Z,user_data=None,user_id='d7ea010b69874f3eb8947e93531e6669',uuid=1a8d5a29-7f30-4c80-8e49-32081a514b2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "address": "fa:16:3e:e7:2e:6c", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b89ef46-36", "ovs_interfaceid": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Converting VIF {"id": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "address": "fa:16:3e:e7:2e:6c", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b89ef46-36", "ovs_interfaceid": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=7b89ef46-36c9-467e-8452-1f9033c3b5b9,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b89ef46-36') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.objects.instance [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lazy-loading 'pci_devices' on Instance uuid 1a8d5a29-7f30-4c80-8e49-32081a514b2c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:50:48 user nova-compute[75826]:   <uuid>1a8d5a29-7f30-4c80-8e49-32081a514b2c</uuid>
Nov 16 00:50:48 user nova-compute[75826]:   <name>instance-00000021</name>
Nov 16 00:50:48 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:50:48 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:50:48 user nova-compute[75826]:   <metadata>
Nov 16 00:50:48 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:50:48 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:50:48 user nova-compute[75826]:       <nova:name>tempest-ServersNegativeTestJSON-server-269779050</nova:name>
Nov 16 00:50:48 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:50:48</nova:creationTime>
Nov 16 00:50:48 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:50:48 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:50:48 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:50:48 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:50:48 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:50:48 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:50:48 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:50:48 user nova-compute[75826]:       <nova:owner>
Nov 16 00:50:48 user nova-compute[75826]:         <nova:user uuid="d7ea010b69874f3eb8947e93531e6669">tempest-ServersNegativeTestJSON-1135241657-project-member</nova:user>
Nov 16 00:50:48 user nova-compute[75826]:         <nova:project uuid="328112cf55d04d8c8bb1b9d5655a2115">tempest-ServersNegativeTestJSON-1135241657</nova:project>
Nov 16 00:50:48 user nova-compute[75826]:       </nova:owner>
Nov 16 00:50:48 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:50:48 user nova-compute[75826]:       <nova:ports>
Nov 16 00:50:48 user nova-compute[75826]:         <nova:port uuid="7b89ef46-36c9-467e-8452-1f9033c3b5b9">
Nov 16 00:50:48 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 16 00:50:48 user nova-compute[75826]:         </nova:port>
Nov 16 00:50:48 user nova-compute[75826]:       </nova:ports>
Nov 16 00:50:48 user nova-compute[75826]:     </nova:instance>
Nov 16 00:50:48 user nova-compute[75826]:   </metadata>
Nov 16 00:50:48 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:50:48 user nova-compute[75826]:     <system>
Nov 16 00:50:48 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:50:48 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:50:48 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:50:48 user nova-compute[75826]:       <entry name="serial">1a8d5a29-7f30-4c80-8e49-32081a514b2c</entry>
Nov 16 00:50:48 user nova-compute[75826]:       <entry name="uuid">1a8d5a29-7f30-4c80-8e49-32081a514b2c</entry>
Nov 16 00:50:48 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:50:48 user nova-compute[75826]:     </system>
Nov 16 00:50:48 user nova-compute[75826]:   </sysinfo>
Nov 16 00:50:48 user nova-compute[75826]:   <os>
Nov 16 00:50:48 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:50:48 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:50:48 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:50:48 user nova-compute[75826]:   </os>
Nov 16 00:50:48 user nova-compute[75826]:   <features>
Nov 16 00:50:48 user nova-compute[75826]:     <acpi/>
Nov 16 00:50:48 user nova-compute[75826]:     <apic/>
Nov 16 00:50:48 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:50:48 user nova-compute[75826]:   </features>
Nov 16 00:50:48 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:50:48 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:50:48 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:50:48 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:50:48 user nova-compute[75826]:   </clock>
Nov 16 00:50:48 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:50:48 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:50:48 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:50:48 user nova-compute[75826]:   </cpu>
Nov 16 00:50:48 user nova-compute[75826]:   <devices>
Nov 16 00:50:48 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:50:48 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:50:48 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk"/>
Nov 16 00:50:48 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:50:48 user nova-compute[75826]:     </disk>
Nov 16 00:50:48 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:50:48 user nova-compute[75826]:       <mac address="fa:16:3e:e7:2e:6c"/>
Nov 16 00:50:48 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:50:48 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:50:48 user nova-compute[75826]:       <target dev="tap7b89ef46-36"/>
Nov 16 00:50:48 user nova-compute[75826]:     </interface>
Nov 16 00:50:48 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:50:48 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/console.log" append="off"/>
Nov 16 00:50:48 user nova-compute[75826]:     </serial>
Nov 16 00:50:48 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:50:48 user nova-compute[75826]:     <video>
Nov 16 00:50:48 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:50:48 user nova-compute[75826]:     </video>
Nov 16 00:50:48 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:50:48 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:50:48 user nova-compute[75826]:     </rng>
Nov 16 00:50:48 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:50:48 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:50:48 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:50:48 user nova-compute[75826]:     </memballoon>
Nov 16 00:50:48 user nova-compute[75826]:   </devices>
Nov 16 00:50:48 user nova-compute[75826]: </domain>
Nov 16 00:50:48 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-269779050',display_name='tempest-ServersNegativeTestJSON-server-269779050',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-269779050',id=33,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='328112cf55d04d8c8bb1b9d5655a2115',ramdisk_id='',reservation_id='r-rrgvs0mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1135241657',owner_user_name='tempest-ServersNegativeTestJSON-1135241657-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:50:47Z,user_data=None,user_id='d7ea010b69874f3eb8947e93531e6669',uuid=1a8d5a29-7f30-4c80-8e49-32081a514b2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "address": "fa:16:3e:e7:2e:6c", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b89ef46-36", "ovs_interfaceid": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Converting VIF {"id": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "address": "fa:16:3e:e7:2e:6c", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b89ef46-36", "ovs_interfaceid": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=7b89ef46-36c9-467e-8452-1f9033c3b5b9,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b89ef46-36') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG os_vif [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=7b89ef46-36c9-467e-8452-1f9033c3b5b9,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b89ef46-36') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9faa6436-1a8b-55d2-88e3-529cc096a669', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:50:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b89ef46-36, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b89ef46-36, col_values=(('qos', UUID('827e9e02-587f-488e-ba59-ace7606bcf52')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b89ef46-36, col_values=(('external_ids', {'iface-id': '7b89ef46-36c9-467e-8452-1f9033c3b5b9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:2e:6c', 'vm-uuid': '1a8d5a29-7f30-4c80-8e49-32081a514b2c'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:50:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:49 user nova-compute[75826]: INFO os_vif [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=7b89ef46-36c9-467e-8452-1f9033c3b5b9,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b89ef46-36')
Nov 16 00:50:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:50:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] No VIF found with MAC fa:16:3e:e7:2e:6c, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:50:49 user nova-compute[75826]: DEBUG nova.network.neutron [req-105b05e1-7448-429d-a400-d1b8dbf62277 req-fa7dd3c9-02be-4aa1-b2b1-cceec552dac1 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Updated VIF entry in instance network info cache for port 7b89ef46-36c9-467e-8452-1f9033c3b5b9. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:50:49 user nova-compute[75826]: DEBUG nova.network.neutron [req-105b05e1-7448-429d-a400-d1b8dbf62277 req-fa7dd3c9-02be-4aa1-b2b1-cceec552dac1 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Updating instance_info_cache with network_info: [{"id": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "address": "fa:16:3e:e7:2e:6c", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b89ef46-36", "ovs_interfaceid": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:50:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-105b05e1-7448-429d-a400-d1b8dbf62277 req-fa7dd3c9-02be-4aa1-b2b1-cceec552dac1 service nova] Releasing lock "refresh_cache-1a8d5a29-7f30-4c80-8e49-32081a514b2c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:50:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-4b261adc-7f20-4b79-b719-aef129ede0fb req-d920b156-4a28-4562-9ff9-3938690e8f33 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Received event network-vif-plugged-7b89ef46-36c9-467e-8452-1f9033c3b5b9 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4b261adc-7f20-4b79-b719-aef129ede0fb req-d920b156-4a28-4562-9ff9-3938690e8f33 service nova] Acquiring lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4b261adc-7f20-4b79-b719-aef129ede0fb req-d920b156-4a28-4562-9ff9-3938690e8f33 service nova] Lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4b261adc-7f20-4b79-b719-aef129ede0fb req-d920b156-4a28-4562-9ff9-3938690e8f33 service nova] Lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-4b261adc-7f20-4b79-b719-aef129ede0fb req-d920b156-4a28-4562-9ff9-3938690e8f33 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] No waiting events found dispatching network-vif-plugged-7b89ef46-36c9-467e-8452-1f9033c3b5b9 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:50 user nova-compute[75826]: WARNING nova.compute.manager [req-4b261adc-7f20-4b79-b719-aef129ede0fb req-d920b156-4a28-4562-9ff9-3938690e8f33 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Received unexpected event network-vif-plugged-7b89ef46-36c9-467e-8452-1f9033c3b5b9 for instance with vm_state building and task_state spawning.
Nov 16 00:50:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:50:51 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Creating image(s)
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Ensure instance console log exists: /opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Start _get_guest_xml network_info=[{"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2edfc124-5c6d-4acc-999d-fdaf5c87365e', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDYTPtyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '34bed458-5248-473d-b022-7f953669d85c', 'attached_at': '', 'detached_at': '', 'volume_id': '8c80aed0-5e47-4143-8665-68f0fd5531bc', 'serial': '8c80aed0-5e47-4143-8665-68f0fd5531bc'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:50:51 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:50:51 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDYTPtyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:50:51 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:50:51 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:50:51 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:50:51 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5e4641de-b527-49ae-aea0-1821c759f9a4 is timed out.
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:51 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Successfully detached device vdb from instance 5e4641de-b527-49ae-aea0-1821c759f9a4 from the live domain config.
Nov 16 00:50:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdebNaRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:50:51 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb22a17-0349-4f53-a389-6eec23660092]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:50:51 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3456034-fc8c-4fab-a050-0e271efd9695]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc] added
Nov 16 00:50:51 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded3d2f2-1012-47df-8e9d-6f3276710aae]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed8ba0a-c32f-4c1a-afa0-4db423573e75]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EDYTPtyH {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EDYTPtyH" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[662204f5-1b3b-44d7-9fd6-fac5f1b3f250]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EDYTPtyH'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[716825ec-8b03-41ae-b341-b8379b693b8c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb69e4e-09fd-4af6-b3e7-76fd08c42533]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:50:51 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:50:51 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcec6f5-008d-4742-8784-91fa9d8f8bae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc, portal: 172.16.0.220,3260]
Nov 16 00:50:51 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc, portal: 172.16.0.220,3260] successful.
Nov 16 00:50:51 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a33eeed-59a7-429a-80c6-5561d3dbca14]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f835a4da-4a88-4d8b-85b3-0e903c80bc98]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:50:51 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:50:51 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:50:51 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.348s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] HCTL ('37', '-', '-', 0) found on session 36 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6ec0de-bf85-424a-9c76-813b9d8f28a7]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching for a device in session 36 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:50:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDYTPtyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '23363636534656538', 'path': '/dev/sdf'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363636534656538', 'path': '/dev/sdf'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.368s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a1d190-31ee-4469-a67a-a76d4cb42c6a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-576016767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-576016767',id=32,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-505msulp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:50:40Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=34bed458-5248-473d-b022-7f953669d85c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f8:ec,bridge_name='br-int',has_traffic_filtering=True,id=edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedccd7c6-eb') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'pci_devices' on Instance uuid 34bed458-5248-473d-b022-7f953669d85c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:50:52 user nova-compute[75826]: No targets found.
Nov 16 00:50:52 user nova-compute[75826]: iSNS:
Nov 16 00:50:52 user nova-compute[75826]: No targets found.
Nov 16 00:50:52 user nova-compute[75826]: STATIC:
Nov 16 00:50:52 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc
Nov 16 00:50:52 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:50:52 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:50:52 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9
Nov 16 00:50:52 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:50:52 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:50:52 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a
Nov 16 00:50:52 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:50:52 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:50:52 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a
Nov 16 00:50:52 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:50:52 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:50:52 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:50:52 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:50:52 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:50:52 user nova-compute[75826]: FIRMWARE:
Nov 16 00:50:52 user nova-compute[75826]: No targets found.
Nov 16 00:50:52 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:50:52 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:50:52 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:50:52 user nova-compute[75826]:   <uuid>34bed458-5248-473d-b022-7f953669d85c</uuid>
Nov 16 00:50:52 user nova-compute[75826]:   <name>instance-00000020</name>
Nov 16 00:50:52 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:50:52 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:50:52 user nova-compute[75826]:   <metadata>
Nov 16 00:50:52 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:50:52 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:50:52 user nova-compute[75826]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-576016767</nova:name>
Nov 16 00:50:52 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:50:51</nova:creationTime>
Nov 16 00:50:52 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:50:52 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:50:52 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:50:52 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:50:52 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:50:52 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:50:52 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:50:52 user nova-compute[75826]:       <nova:owner>
Nov 16 00:50:52 user nova-compute[75826]:         <nova:user uuid="f8606321461c403cbec7f0a36e454bc8">tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member</nova:user>
Nov 16 00:50:52 user nova-compute[75826]:         <nova:project uuid="e45c7fd936b74e109f83fc69060af216">tempest-ServerBootFromVolumeStableRescueTest-1116494461</nova:project>
Nov 16 00:50:52 user nova-compute[75826]:       </nova:owner>
Nov 16 00:50:52 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:50:52 user nova-compute[75826]:       <nova:ports>
Nov 16 00:50:52 user nova-compute[75826]:         <nova:port uuid="edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e">
Nov 16 00:50:52 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 00:50:52 user nova-compute[75826]:         </nova:port>
Nov 16 00:50:52 user nova-compute[75826]:       </nova:ports>
Nov 16 00:50:52 user nova-compute[75826]:     </nova:instance>
Nov 16 00:50:52 user nova-compute[75826]:   </metadata>
Nov 16 00:50:52 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:50:52 user nova-compute[75826]:     <system>
Nov 16 00:50:52 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:50:52 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:50:52 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:50:52 user nova-compute[75826]:       <entry name="serial">34bed458-5248-473d-b022-7f953669d85c</entry>
Nov 16 00:50:52 user nova-compute[75826]:       <entry name="uuid">34bed458-5248-473d-b022-7f953669d85c</entry>
Nov 16 00:50:52 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:50:52 user nova-compute[75826]:     </system>
Nov 16 00:50:52 user nova-compute[75826]:   </sysinfo>
Nov 16 00:50:52 user nova-compute[75826]:   <os>
Nov 16 00:50:52 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:50:52 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:50:52 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:50:52 user nova-compute[75826]:   </os>
Nov 16 00:50:52 user nova-compute[75826]:   <features>
Nov 16 00:50:52 user nova-compute[75826]:     <acpi/>
Nov 16 00:50:52 user nova-compute[75826]:     <apic/>
Nov 16 00:50:52 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:50:52 user nova-compute[75826]:   </features>
Nov 16 00:50:52 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:50:52 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:50:52 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:50:52 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:50:52 user nova-compute[75826]:   </clock>
Nov 16 00:50:52 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:50:52 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:50:52 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:50:52 user nova-compute[75826]:   </cpu>
Nov 16 00:50:52 user nova-compute[75826]:   <devices>
Nov 16 00:50:52 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:50:52 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:50:52 user nova-compute[75826]:       <source dev="/dev/sdf"/>
Nov 16 00:50:52 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:50:52 user nova-compute[75826]:       <serial>8c80aed0-5e47-4143-8665-68f0fd5531bc</serial>
Nov 16 00:50:52 user nova-compute[75826]:     </disk>
Nov 16 00:50:52 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:50:52 user nova-compute[75826]:       <mac address="fa:16:3e:52:f8:ec"/>
Nov 16 00:50:52 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:50:52 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:50:52 user nova-compute[75826]:       <target dev="tapedccd7c6-eb"/>
Nov 16 00:50:52 user nova-compute[75826]:     </interface>
Nov 16 00:50:52 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:50:52 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/console.log" append="off"/>
Nov 16 00:50:52 user nova-compute[75826]:     </serial>
Nov 16 00:50:52 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:50:52 user nova-compute[75826]:     <video>
Nov 16 00:50:52 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:50:52 user nova-compute[75826]:     </video>
Nov 16 00:50:52 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:50:52 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:50:52 user nova-compute[75826]:     </rng>
Nov 16 00:50:52 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:50:52 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:50:52 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:50:52 user nova-compute[75826]:     </memballoon>
Nov 16 00:50:52 user nova-compute[75826]:   </devices>
Nov 16 00:50:52 user nova-compute[75826]: </domain>
Nov 16 00:50:52 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-576016767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-576016767',id=32,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-505msulp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:50:40Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=34bed458-5248-473d-b022-7f953669d85c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:f8:ec,bridge_name='br-int',has_traffic_filtering=True,id=edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedccd7c6-eb') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG os_vif [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f8:ec,bridge_name='br-int',has_traffic_filtering=True,id=edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedccd7c6-eb') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd3841de7-7bb8-5d9a-8a05-ff6ad90cce8c', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f519a239-b2f0-43e4-a20f-d5a9d789186f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapedccd7c6-eb, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapedccd7c6-eb, col_values=(('qos', UUID('64242cc8-5940-422d-b7b4-2be09f782f58')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapedccd7c6-eb, col_values=(('external_ids', {'iface-id': 'edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:f8:ec', 'vm-uuid': '34bed458-5248-473d-b022-7f953669d85c'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[023ce056-5f6b-4310-b6e3-c5364077709a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:52 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:52 user nova-compute[75826]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)
Nov 16 00:50:52 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:50:52 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:50:52 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:52 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:52 user nova-compute[75826]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a (non-flash)
Nov 16 00:50:52 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:50:52 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:50:52 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb4252050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a'): ({'sdd'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Removing single pathed devices sdd {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:52 user nova-compute[75826]: INFO os_vif [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:f8:ec,bridge_name='br-int',has_traffic_filtering=True,id=edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedccd7c6-eb')
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[44be13d3-d797-4cc1-9dc7-93c270825511]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:52 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Instance spawned successfully.
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.compute.manager [req-0b111a85-d5d6-4f27-b8fc-99500d4707f0 req-5ad12aa7-05b0-47e8-8c5f-d4e6066f5564 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Received event network-vif-plugged-7b89ef46-36c9-467e-8452-1f9033c3b5b9 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0b111a85-d5d6-4f27-b8fc-99500d4707f0 req-5ad12aa7-05b0-47e8-8c5f-d4e6066f5564 service nova] Acquiring lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0b111a85-d5d6-4f27-b8fc-99500d4707f0 req-5ad12aa7-05b0-47e8-8c5f-d4e6066f5564 service nova] Lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0b111a85-d5d6-4f27-b8fc-99500d4707f0 req-5ad12aa7-05b0-47e8-8c5f-d4e6066f5564 service nova] Lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.compute.manager [req-0b111a85-d5d6-4f27-b8fc-99500d4707f0 req-5ad12aa7-05b0-47e8-8c5f-d4e6066f5564 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] No waiting events found dispatching network-vif-plugged-7b89ef46-36c9-467e-8452-1f9033c3b5b9 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:52 user nova-compute[75826]: WARNING nova.compute.manager [req-0b111a85-d5d6-4f27-b8fc-99500d4707f0 req-5ad12aa7-05b0-47e8-8c5f-d4e6066f5564 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Received unexpected event network-vif-plugged-7b89ef46-36c9-467e-8452-1f9033c3b5b9 for instance with vm_state building and task_state spawning.
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1933fc-d4e1-4b72-adb4-69dcec2c07f2]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Flushing IO for device /dev/sdd {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[90762c70-3612-4677-bcc7-6cda8d4cb9a3]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:50:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No VIF found with MAC fa:16:3e:52:f8:ec, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.060s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[543dc092-3eb8-47b2-8700-3aa4d1e551f5]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd28115c-f346-4225-82ea-a215ad2b11cd]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:53 user nova-compute[75826]: INFO nova.compute.manager [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Took 5.93 seconds to spawn the instance on the hypervisor.
Nov 16 00:50:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f21bf83-2a4e-4ada-b1b9-1a6b4092d847]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a, portal: 172.16.0.220,3260]
Nov 16 00:50:53 user nova-compute[75826]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a, portal: 172.16.0.220,3260] successful.
Nov 16 00:50:53 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[db639b28-90e0-4b4a-b49c-116f1b0b03be]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] <== disconnect_volume: return (1756ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:50:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:50:53 user nova-compute[75826]: INFO nova.compute.manager [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Took 6.92 seconds to build instance.
Nov 16 00:50:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b5bb3cf-2604-47f1-a7d6-b3d3d81af0b4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.028s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG nova.objects.instance [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lazy-loading 'flavor' on Instance uuid 5e4641de-b527-49ae-aea0-1821c759f9a4 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-37774ffc-8179-4563-b24b-b3c1cadd9247 tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.309s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 23.081s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:54 user nova-compute[75826]: INFO nova.compute.manager [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Terminating instance
Nov 16 00:50:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-9ffaaad4-0447-4c51-9ed1-7d4020dc0d68 req-391fc59e-ce08-48ec-9e6a-a8b497587c45 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received event network-vif-unplugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9ffaaad4-0447-4c51-9ed1-7d4020dc0d68 req-391fc59e-ce08-48ec-9e6a-a8b497587c45 service nova] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9ffaaad4-0447-4c51-9ed1-7d4020dc0d68 req-391fc59e-ce08-48ec-9e6a-a8b497587c45 service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9ffaaad4-0447-4c51-9ed1-7d4020dc0d68 req-391fc59e-ce08-48ec-9e6a-a8b497587c45 service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-9ffaaad4-0447-4c51-9ed1-7d4020dc0d68 req-391fc59e-ce08-48ec-9e6a-a8b497587c45 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] No waiting events found dispatching network-vif-unplugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-9ffaaad4-0447-4c51-9ed1-7d4020dc0d68 req-391fc59e-ce08-48ec-9e6a-a8b497587c45 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received event network-vif-unplugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-be5c5794-1065-4041-ad14-369bb3e48d45 req-04709222-92d0-4a84-877b-44a6e803f1e4 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-be5c5794-1065-4041-ad14-369bb3e48d45 req-04709222-92d0-4a84-877b-44a6e803f1e4 service nova] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-be5c5794-1065-4041-ad14-369bb3e48d45 req-04709222-92d0-4a84-877b-44a6e803f1e4 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-be5c5794-1065-4041-ad14-369bb3e48d45 req-04709222-92d0-4a84-877b-44a6e803f1e4 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-be5c5794-1065-4041-ad14-369bb3e48d45 req-04709222-92d0-4a84-877b-44a6e803f1e4 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] No waiting events found dispatching network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:54 user nova-compute[75826]: WARNING nova.compute.manager [req-be5c5794-1065-4041-ad14-369bb3e48d45 req-04709222-92d0-4a84-877b-44a6e803f1e4 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received unexpected event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e for instance with vm_state building and task_state spawning.
Nov 16 00:50:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-be5c5794-1065-4041-ad14-369bb3e48d45 req-04709222-92d0-4a84-877b-44a6e803f1e4 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-be5c5794-1065-4041-ad14-369bb3e48d45 req-04709222-92d0-4a84-877b-44a6e803f1e4 service nova] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-be5c5794-1065-4041-ad14-369bb3e48d45 req-04709222-92d0-4a84-877b-44a6e803f1e4 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-be5c5794-1065-4041-ad14-369bb3e48d45 req-04709222-92d0-4a84-877b-44a6e803f1e4 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-be5c5794-1065-4041-ad14-369bb3e48d45 req-04709222-92d0-4a84-877b-44a6e803f1e4 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] No waiting events found dispatching network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:54 user nova-compute[75826]: WARNING nova.compute.manager [req-be5c5794-1065-4041-ad14-369bb3e48d45 req-04709222-92d0-4a84-877b-44a6e803f1e4 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received unexpected event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e for instance with vm_state building and task_state spawning.
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Instance destroyed successfully.
Nov 16 00:50:55 user nova-compute[75826]: DEBUG nova.objects.instance [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lazy-loading 'resources' on Instance uuid 5e4641de-b527-49ae-aea0-1821c759f9a4 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:48:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1601870779',display_name='tempest-VolumesSnapshotTestJSON-instance-1601870779',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1601870779',id=27,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG1MdX47cBMQU/nCPZG+GXBiHpsk5dg9ZWdTbajcjQ2Ceo/NJ+8B3s5uW1/hOz1wzdbjMuoUiUVlM0O+S4RanBrv6bwJL/BGTP3TYU5pWptGTPnkO8fgwivOdrjnXBQXkw==',key_name='tempest-keypair-1905539434',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:48:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d6b9da552fd49509a93b461cceb15ad',ramdisk_id='',reservation_id='r-lv4b7jpi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1407250662',owner_user_name='tempest-VolumesSnapshotTestJSON-1407250662-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:48:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ca3f8ab341484fc6ae7176cd66e18e7b',uuid=5e4641de-b527-49ae-aea0-1821c759f9a4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "address": "fa:16:3e:7a:57:14", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2e60a2-3b", "ovs_interfaceid": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Converting VIF {"id": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "address": "fa:16:3e:7a:57:14", "network": {"id": "b8b97193-1931-4ad4-9c43-efcd7ffabc85", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1001135234-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6b9da552fd49509a93b461cceb15ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa2e60a2-3b", "ovs_interfaceid": "aa2e60a2-3b7d-4532-82ff-49b9f83bc648", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:57:14,bridge_name='br-int',has_traffic_filtering=True,id=aa2e60a2-3b7d-4532-82ff-49b9f83bc648,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2e60a2-3b') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG os_vif [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:57:14,bridge_name='br-int',has_traffic_filtering=True,id=aa2e60a2-3b7d-4532-82ff-49b9f83bc648,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2e60a2-3b') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa2e60a2-3b, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=73229670-90d8-4bdc-bf8c-3190addc218e) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: INFO os_vif [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:57:14,bridge_name='br-int',has_traffic_filtering=True,id=aa2e60a2-3b7d-4532-82ff-49b9f83bc648,network=Network(b8b97193-1931-4ad4-9c43-efcd7ffabc85),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa2e60a2-3b')
Nov 16 00:50:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IdebNaRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:50:55 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:50:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80deea2-6e7c-487f-ac0f-07288e30dafb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:50:55 user nova-compute[75826]: No targets found.
Nov 16 00:50:55 user nova-compute[75826]: iSNS:
Nov 16 00:50:55 user nova-compute[75826]: No targets found.
Nov 16 00:50:55 user nova-compute[75826]: STATIC:
Nov 16 00:50:55 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc
Nov 16 00:50:55 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:50:55 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:50:55 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9
Nov 16 00:50:55 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:50:55 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:50:55 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a
Nov 16 00:50:55 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:50:55 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:50:55 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:50:55 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:50:55 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:50:55 user nova-compute[75826]: FIRMWARE:
Nov 16 00:50:55 user nova-compute[75826]: No targets found.
Nov 16 00:50:55 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:50:55 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:50:55 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dbc03b2e-e097-48dd-94b8-bb0dcd2e172a', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1e9f43-cf35-46d4-8d56-6c60b3224571]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e004bd0b-6edb-4223-812e-b1709dcae992]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:55 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:55 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:50:55 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:50:55 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:50:55 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:50:55 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:50:55 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:50:55 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd94531630>, {}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Disconnecting from: [] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.134s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] <== disconnect_volume: return (135ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:50:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Deleting instance files /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4_del
Nov 16 00:50:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Deletion of /opt/stack/data/nova/instances/5e4641de-b527-49ae-aea0-1821c759f9a4_del complete
Nov 16 00:50:55 user nova-compute[75826]: INFO nova.compute.manager [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Took 1.34 seconds to destroy the instance on the hypervisor.
Nov 16 00:50:55 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received event network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] No waiting events found dispatching network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:56 user nova-compute[75826]: WARNING nova.compute.manager [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received unexpected event network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 for instance with vm_state active and task_state deleting.
Nov 16 00:50:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received event network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] No waiting events found dispatching network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:56 user nova-compute[75826]: WARNING nova.compute.manager [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received unexpected event network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 for instance with vm_state active and task_state deleting.
Nov 16 00:50:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received event network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] No waiting events found dispatching network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:56 user nova-compute[75826]: WARNING nova.compute.manager [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received unexpected event network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 for instance with vm_state active and task_state deleting.
Nov 16 00:50:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received event network-vif-unplugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] No waiting events found dispatching network-vif-unplugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-f9ec45a3-4751-4f12-9d47-7a4656506b6e req-7363ed79-6046-4d13-9cc8-42a5367f1191 service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received event network-vif-unplugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:50:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:50:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:50:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 34bed458-5248-473d-b022-7f953669d85c] Instance spawned successfully.
Nov 16 00:50:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:50:57 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:50:57 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Took 1.76 seconds to deallocate network for instance.
Nov 16 00:50:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:50:57 user nova-compute[75826]: WARNING nova.volume.cinder [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Attachment 5bf84cd4-9fe7-44b4-9f9d-1861bd0dbe68 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 5bf84cd4-9fe7-44b4-9f9d-1861bd0dbe68. (HTTP 404) (Request-ID: req-e06f0ba4-5935-43d0-a936-b865726c7791)
Nov 16 00:50:57 user nova-compute[75826]: INFO nova.compute.manager [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Took 0.03 seconds to detach 1 volumes for instance.
Nov 16 00:50:57 user nova-compute[75826]: INFO nova.compute.manager [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 16 00:50:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:50:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:57 user nova-compute[75826]: INFO nova.compute.manager [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Took 18.04 seconds to build instance.
Nov 16 00:50:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c7223ba2-ecb4-4fd9-9b23-196a5d6d9c33 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "34bed458-5248-473d-b022-7f953669d85c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.162s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:57 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:50:57 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:50:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:57 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Deleted allocations for instance 5e4641de-b527-49ae-aea0-1821c759f9a4
Nov 16 00:50:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-cab0b6a1-9957-4148-9144-426324972c2e tempest-VolumesSnapshotTestJSON-1407250662 tempest-VolumesSnapshotTestJSON-1407250662-project-member] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.796s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-1de9501b-e212-4d88-b360-0be036bd9687 req-cc2ea50b-3adf-48d0-9606-08b3c4c0d0df service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received event network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1de9501b-e212-4d88-b360-0be036bd9687 req-cc2ea50b-3adf-48d0-9606-08b3c4c0d0df service nova] Acquiring lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:50:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1de9501b-e212-4d88-b360-0be036bd9687 req-cc2ea50b-3adf-48d0-9606-08b3c4c0d0df service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:50:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1de9501b-e212-4d88-b360-0be036bd9687 req-cc2ea50b-3adf-48d0-9606-08b3c4c0d0df service nova] Lock "5e4641de-b527-49ae-aea0-1821c759f9a4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:50:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-1de9501b-e212-4d88-b360-0be036bd9687 req-cc2ea50b-3adf-48d0-9606-08b3c4c0d0df service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] No waiting events found dispatching network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:50:58 user nova-compute[75826]: WARNING nova.compute.manager [req-1de9501b-e212-4d88-b360-0be036bd9687 req-cc2ea50b-3adf-48d0-9606-08b3c4c0d0df service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received unexpected event network-vif-plugged-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 for instance with vm_state deleted and task_state None.
Nov 16 00:50:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-1de9501b-e212-4d88-b360-0be036bd9687 req-cc2ea50b-3adf-48d0-9606-08b3c4c0d0df service nova] [instance: 5e4641de-b527-49ae-aea0-1821c759f9a4] Received event network-vif-deleted-aa2e60a2-3b7d-4532-82ff-49b9f83bc648 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:50:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG nova.objects.instance [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lazy-loading 'info_cache' on Instance uuid 13b9b8b9-6ab1-4a8a-853f-00769b543743 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Updating instance_info_cache with network_info: [{"id": "378f1586-075a-47fc-8723-540896093fe4", "address": "fa:16:3e:7d:d3:79", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378f1586-07", "ovs_interfaceid": "378f1586-075a-47fc-8723-540896093fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-13b9b8b9-6ab1-4a8a-853f-00769b543743" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:51:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:06 user nova-compute[75826]: INFO nova.compute.manager [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Detaching volume ae4ea703-ed6d-4ae0-945f-dfa71deefc0a
Nov 16 00:51:06 user nova-compute[75826]: INFO nova.virt.block_device [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Attempting to driver detach volume ae4ea703-ed6d-4ae0-945f-dfa71deefc0a from mountpoint /dev/vdb
Nov 16 00:51:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Attempting to detach device vdb from instance b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:51:06 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:51:06 user nova-compute[75826]:   <source dev="/dev/sdc"/>
Nov 16 00:51:06 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:51:06 user nova-compute[75826]:   <serial>ae4ea703-ed6d-4ae0-945f-dfa71deefc0a</serial>
Nov 16 00:51:06 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:51:06 user nova-compute[75826]: </disk>
Nov 16 00:51:06 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:06 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully detached device vdb from instance b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 from the persistent domain config.
Nov 16 00:51:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:51:06 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:51:06 user nova-compute[75826]:   <source dev="/dev/sdc"/>
Nov 16 00:51:06 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:51:06 user nova-compute[75826]:   <serial>ae4ea703-ed6d-4ae0-945f-dfa71deefc0a</serial>
Nov 16 00:51:06 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:51:06 user nova-compute[75826]: </disk>
Nov 16 00:51:06 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:51:07 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:51:07 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7606MB free_disk=25.24657440185547GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 298c8986-b91b-4f46-bcce-75e28bc02b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 87b2703e-0154-445e-b659-5f5cf1d9f8f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance cc77d9aa-4052-40dd-9495-3a516d8f0793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance cb8a1a92-10de-4bdc-b730-83bae29ff92b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 38a96872-51b5-448d-83c8-f722520d128c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 34bed458-5248-473d-b022-7f953669d85c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 1a8d5a29-7f30-4c80-8e49-32081a514b2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:51:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:51:08 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:51:08 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:51:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:51:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.706s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:51:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:51:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:51:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:51:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:51:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:51:11 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'flavor' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquired lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'info_cache' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.objects.base [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Updating instance_info_cache with network_info: [{"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Releasing lock "refresh_cache-298c8986-b91b-4f46-bcce-75e28bc02b5f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:51:12 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Instance destroyed successfully.
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'resources' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.objects.base [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1610404613',display_name='tempest-AttachVolumeTestJSON-server-1610404613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1610404613',id=17,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPd46vcTYm1IGljsZJY5d+bnsYtZu5mDPgxXnccpiKGtfwu7f4jNN4sCNE2xSEkbiGF7AI/QCdZlu654F87C0DsVVQp1j+jeloZ54u8nfEkpLHA8I7BQPi8srBhE2Ey6w==',key_name='tempest-keypair-1910536779',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:43:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='aa522b01f20c4d90bc4178e688319e7f',ramdisk_id='',reservation_id='r-tf175bq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1305137356',owner_user_name='tempest-AttachVolumeTestJSON-1305137356-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:49:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96797fc178ed4c2190f7a760b3bd30bd',uuid=298c8986-b91b-4f46-bcce-75e28bc02b5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converting VIF {"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG os_vif [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff64782d-04, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a3d6363c-e057-4bdf-89ab-1876269b5989) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:12 user nova-compute[75826]: INFO os_vif [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04')
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Start _get_guest_xml network_info=[{"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'numa_topology' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.objects.base [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:51:12 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:51:12 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'vcpu_model' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.objects.base [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1610404613',display_name='tempest-AttachVolumeTestJSON-server-1610404613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1610404613',id=17,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPd46vcTYm1IGljsZJY5d+bnsYtZu5mDPgxXnccpiKGtfwu7f4jNN4sCNE2xSEkbiGF7AI/QCdZlu654F87C0DsVVQp1j+jeloZ54u8nfEkpLHA8I7BQPi8srBhE2Ey6w==',key_name='tempest-keypair-1910536779',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:43:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='aa522b01f20c4d90bc4178e688319e7f',ramdisk_id='',reservation_id='r-tf175bq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1305137356',owner_user_name='tempest-AttachVolumeTestJSON-1305137356-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:49:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96797fc178ed4c2190f7a760b3bd30bd',uuid=298c8986-b91b-4f46-bcce-75e28bc02b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converting VIF {"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'pci_devices' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.objects.base [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:51:12 user nova-compute[75826]:   <uuid>298c8986-b91b-4f46-bcce-75e28bc02b5f</uuid>
Nov 16 00:51:12 user nova-compute[75826]:   <name>instance-00000011</name>
Nov 16 00:51:12 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:51:12 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:51:12 user nova-compute[75826]:   <metadata>
Nov 16 00:51:12 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:51:12 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:51:12 user nova-compute[75826]:       <nova:name>tempest-AttachVolumeTestJSON-server-1610404613</nova:name>
Nov 16 00:51:12 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:51:12</nova:creationTime>
Nov 16 00:51:12 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:51:12 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:51:12 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:51:12 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:51:12 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:51:12 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:51:12 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:51:12 user nova-compute[75826]:       <nova:owner>
Nov 16 00:51:12 user nova-compute[75826]:         <nova:user uuid="96797fc178ed4c2190f7a760b3bd30bd">tempest-AttachVolumeTestJSON-1305137356-project-member</nova:user>
Nov 16 00:51:12 user nova-compute[75826]:         <nova:project uuid="aa522b01f20c4d90bc4178e688319e7f">tempest-AttachVolumeTestJSON-1305137356</nova:project>
Nov 16 00:51:12 user nova-compute[75826]:       </nova:owner>
Nov 16 00:51:12 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:51:12 user nova-compute[75826]:       <nova:ports>
Nov 16 00:51:12 user nova-compute[75826]:         <nova:port uuid="ff64782d-047b-4488-80c5-b8866a0c5037">
Nov 16 00:51:12 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 00:51:12 user nova-compute[75826]:         </nova:port>
Nov 16 00:51:12 user nova-compute[75826]:       </nova:ports>
Nov 16 00:51:12 user nova-compute[75826]:     </nova:instance>
Nov 16 00:51:12 user nova-compute[75826]:   </metadata>
Nov 16 00:51:12 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:51:12 user nova-compute[75826]:     <system>
Nov 16 00:51:12 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:51:12 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:51:12 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:51:12 user nova-compute[75826]:       <entry name="serial">298c8986-b91b-4f46-bcce-75e28bc02b5f</entry>
Nov 16 00:51:12 user nova-compute[75826]:       <entry name="uuid">298c8986-b91b-4f46-bcce-75e28bc02b5f</entry>
Nov 16 00:51:12 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:51:12 user nova-compute[75826]:     </system>
Nov 16 00:51:12 user nova-compute[75826]:   </sysinfo>
Nov 16 00:51:12 user nova-compute[75826]:   <os>
Nov 16 00:51:12 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:51:12 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:51:12 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:51:12 user nova-compute[75826]:   </os>
Nov 16 00:51:12 user nova-compute[75826]:   <features>
Nov 16 00:51:12 user nova-compute[75826]:     <acpi/>
Nov 16 00:51:12 user nova-compute[75826]:     <apic/>
Nov 16 00:51:12 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:51:12 user nova-compute[75826]:   </features>
Nov 16 00:51:12 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:51:12 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:51:12 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:51:12 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:51:12 user nova-compute[75826]:   </clock>
Nov 16 00:51:12 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:51:12 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:51:12 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:51:12 user nova-compute[75826]:   </cpu>
Nov 16 00:51:12 user nova-compute[75826]:   <devices>
Nov 16 00:51:12 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:51:12 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:51:12 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk"/>
Nov 16 00:51:12 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:51:12 user nova-compute[75826]:     </disk>
Nov 16 00:51:12 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:51:12 user nova-compute[75826]:       <mac address="fa:16:3e:fc:58:e0"/>
Nov 16 00:51:12 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:51:12 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:51:12 user nova-compute[75826]:       <target dev="tapff64782d-04"/>
Nov 16 00:51:12 user nova-compute[75826]:     </interface>
Nov 16 00:51:12 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:51:12 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/console.log" append="off"/>
Nov 16 00:51:12 user nova-compute[75826]:     </serial>
Nov 16 00:51:12 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:51:12 user nova-compute[75826]:     <video>
Nov 16 00:51:12 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:51:12 user nova-compute[75826]:     </video>
Nov 16 00:51:12 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:51:12 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:51:12 user nova-compute[75826]:     </rng>
Nov 16 00:51:12 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:51:12 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:51:12 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:51:12 user nova-compute[75826]:     </memballoon>
Nov 16 00:51:12 user nova-compute[75826]:   </devices>
Nov 16 00:51:12 user nova-compute[75826]: </domain>
Nov 16 00:51:12 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'trusted_certs' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG nova.objects.base [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.189s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Cannot resize image /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'migration_context' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG nova.objects.base [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Object Instance<298c8986-b91b-4f46-bcce-75e28bc02b5f> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1610404613',display_name='tempest-AttachVolumeTestJSON-server-1610404613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1610404613',id=17,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPd46vcTYm1IGljsZJY5d+bnsYtZu5mDPgxXnccpiKGtfwu7f4jNN4sCNE2xSEkbiGF7AI/QCdZlu654F87C0DsVVQp1j+jeloZ54u8nfEkpLHA8I7BQPi8srBhE2Ey6w==',key_name='tempest-keypair-1910536779',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:43:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='aa522b01f20c4d90bc4178e688319e7f',ramdisk_id='',reservation_id='r-tf175bq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1305137356',owner_user_name='tempest-AttachVolumeTestJSON-1305137356-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:49:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96797fc178ed4c2190f7a760b3bd30bd',uuid=298c8986-b91b-4f46-bcce-75e28bc02b5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converting VIF {"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG os_vif [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87081e3d-e6cc-58df-8179-db816c643a62', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff64782d-04, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff64782d-04, col_values=(('qos', UUID('3e8ea70e-35a8-4c5e-8fef-0f34b75726fc')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff64782d-04, col_values=(('external_ids', {'iface-id': 'ff64782d-047b-4488-80c5-b8866a0c5037', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:58:e0', 'vm-uuid': '298c8986-b91b-4f46-bcce-75e28bc02b5f'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:51:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:13 user nova-compute[75826]: INFO os_vif [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04')
Nov 16 00:51:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbe79931-7176-47fd-af45-f7b1fba8cc2c req-b97667ba-16fb-411b-97a0-a978df84fd20 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:51:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbe79931-7176-47fd-af45-f7b1fba8cc2c req-b97667ba-16fb-411b-97a0-a978df84fd20 service nova] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbe79931-7176-47fd-af45-f7b1fba8cc2c req-b97667ba-16fb-411b-97a0-a978df84fd20 service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fbe79931-7176-47fd-af45-f7b1fba8cc2c req-b97667ba-16fb-411b-97a0-a978df84fd20 service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-fbe79931-7176-47fd-af45-f7b1fba8cc2c req-b97667ba-16fb-411b-97a0-a978df84fd20 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] No waiting events found dispatching network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:51:15 user nova-compute[75826]: WARNING nova.compute.manager [req-fbe79931-7176-47fd-af45-f7b1fba8cc2c req-b97667ba-16fb-411b-97a0-a978df84fd20 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received unexpected event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 for instance with vm_state stopped and task_state powering-on.
Nov 16 00:51:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-e052f95d-4031-42dd-a428-caae15efac9d req-275ba413-b285-48a6-aed2-ea5380f618aa service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:51:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e052f95d-4031-42dd-a428-caae15efac9d req-275ba413-b285-48a6-aed2-ea5380f618aa service nova] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e052f95d-4031-42dd-a428-caae15efac9d req-275ba413-b285-48a6-aed2-ea5380f618aa service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e052f95d-4031-42dd-a428-caae15efac9d req-275ba413-b285-48a6-aed2-ea5380f618aa service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:17 user nova-compute[75826]: DEBUG nova.compute.manager [req-e052f95d-4031-42dd-a428-caae15efac9d req-275ba413-b285-48a6-aed2-ea5380f618aa service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] No waiting events found dispatching network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:51:17 user nova-compute[75826]: WARNING nova.compute.manager [req-e052f95d-4031-42dd-a428-caae15efac9d req-275ba413-b285-48a6-aed2-ea5380f618aa service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received unexpected event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 for instance with vm_state stopped and task_state powering-on.
Nov 16 00:51:17 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:51:17 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Instance rebooted successfully.
Nov 16 00:51:17 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4a02e546-604a-408d-896a-c1557b351b0b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:51:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-579fc0bf-e4c0-4d14-bf85-8b1f5bbf6591 req-fa413a08-f9c8-4193-aec4-6ff420747414 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-changed-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:51:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-579fc0bf-e4c0-4d14-bf85-8b1f5bbf6591 req-fa413a08-f9c8-4193-aec4-6ff420747414 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Refreshing instance network info cache due to event network-changed-5c4ad1d8-e2df-47a7-9305-538ad370dfba. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:51:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-579fc0bf-e4c0-4d14-bf85-8b1f5bbf6591 req-fa413a08-f9c8-4193-aec4-6ff420747414 service nova] Acquiring lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:51:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-579fc0bf-e4c0-4d14-bf85-8b1f5bbf6591 req-fa413a08-f9c8-4193-aec4-6ff420747414 service nova] Acquired lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:51:26 user nova-compute[75826]: DEBUG nova.network.neutron [req-579fc0bf-e4c0-4d14-bf85-8b1f5bbf6591 req-fa413a08-f9c8-4193-aec4-6ff420747414 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Refreshing network info cache for port 5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:51:26 user nova-compute[75826]: DEBUG nova.network.neutron [req-579fc0bf-e4c0-4d14-bf85-8b1f5bbf6591 req-fa413a08-f9c8-4193-aec4-6ff420747414 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Updated VIF entry in instance network info cache for port 5c4ad1d8-e2df-47a7-9305-538ad370dfba. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:51:26 user nova-compute[75826]: DEBUG nova.network.neutron [req-579fc0bf-e4c0-4d14-bf85-8b1f5bbf6591 req-fa413a08-f9c8-4193-aec4-6ff420747414 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Updating instance_info_cache with network_info: [{"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:51:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-579fc0bf-e4c0-4d14-bf85-8b1f5bbf6591 req-fa413a08-f9c8-4193-aec4-6ff420747414 service nova] Releasing lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:51:27 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 is timed out.
Nov 16 00:51:27 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully detached device vdb from instance b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 from the live domain config.
Nov 16 00:51:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'liNbKdXO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:51:27 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d707fa66-a471-463b-a3a3-c3300c4a1d85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:51:27 user nova-compute[75826]: No targets found.
Nov 16 00:51:27 user nova-compute[75826]: iSNS:
Nov 16 00:51:27 user nova-compute[75826]: No targets found.
Nov 16 00:51:27 user nova-compute[75826]: STATIC:
Nov 16 00:51:27 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc
Nov 16 00:51:27 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:51:27 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:51:27 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9
Nov 16 00:51:27 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:51:27 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:51:27 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a
Nov 16 00:51:27 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:51:27 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:51:27 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:51:27 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:51:27 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:51:27 user nova-compute[75826]: FIRMWARE:
Nov 16 00:51:27 user nova-compute[75826]: No targets found.
Nov 16 00:51:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:51:27 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:51:27 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0575c167-1bfa-4b92-a18c-3f2a6007e8d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[149f6163-8f76-4915-9e99-f480fd1ef599]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:51:27 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:51:27 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:51:27 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:51:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:51:27 user nova-compute[75826]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a (non-flash)
Nov 16 00:51:27 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:51:27 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:51:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd94530280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a'): ({'sdc'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Removing single pathed devices sdc {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3f1768-fe44-4291-a2ce-aab962de248f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c86c65-ba0e-4cbc-aae0-79d3c6030093]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Flushing IO for device /dev/sdc {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb42afa5-2856-4af2-a53a-a21995ce267f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b1cdfd-adff-415f-89e1-55b26f19f44f]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[224e89a6-e040-47ff-a20b-0d827e59e43f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6709e549-2fcf-4b48-8d6b-67281f93f4f8]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a, portal: 172.16.0.220,3260]
Nov 16 00:51:27 user nova-compute[75826]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a, portal: 172.16.0.220,3260] successful.
Nov 16 00:51:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae4ea703-ed6d-4ae0-945f-dfa71deefc0a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[646c77be-4915-444b-87a6-915d60c431d0]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] <== disconnect_volume: return (313ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:51:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:51:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:29 user nova-compute[75826]: DEBUG nova.objects.instance [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'flavor' on Instance uuid b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:51:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-17a3a878-0cd8-42a3-ade7-11f52f353e31 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.646s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:31 user nova-compute[75826]: INFO nova.compute.manager [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Shelving
Nov 16 00:51:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-c38f93a4-3b24-4b6b-a0fe-dd8210bc9f12 req-f352530b-485c-4837-93e5-3b23cf2a4135 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-vif-unplugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:51:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c38f93a4-3b24-4b6b-a0fe-dd8210bc9f12 req-f352530b-485c-4837-93e5-3b23cf2a4135 service nova] Acquiring lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c38f93a4-3b24-4b6b-a0fe-dd8210bc9f12 req-f352530b-485c-4837-93e5-3b23cf2a4135 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c38f93a4-3b24-4b6b-a0fe-dd8210bc9f12 req-f352530b-485c-4837-93e5-3b23cf2a4135 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-c38f93a4-3b24-4b6b-a0fe-dd8210bc9f12 req-f352530b-485c-4837-93e5-3b23cf2a4135 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] No waiting events found dispatching network-vif-unplugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:51:31 user nova-compute[75826]: WARNING nova.compute.manager [req-c38f93a4-3b24-4b6b-a0fe-dd8210bc9f12 req-f352530b-485c-4837-93e5-3b23cf2a4135 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received unexpected event network-vif-unplugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba for instance with vm_state active and task_state shelving.
Nov 16 00:51:32 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Instance destroyed successfully.
Nov 16 00:51:32 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Beginning cold snapshot process
Nov 16 00:51:32 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:51:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk /opt/stack/data/nova/instances/snapshots/tmpzyhpdl56/52e098e727fe4f77ab2ee6b4c6e15ea9 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:51:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk /opt/stack/data/nova/instances/snapshots/tmpzyhpdl56/52e098e727fe4f77ab2ee6b4c6e15ea9" returned: 0 in 0.900s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:51:33 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Snapshot extracted, beginning image upload
Nov 16 00:51:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-7de996d4-d541-4d6f-a347-5a18f425e138 req-caaa696d-2d94-48cc-b07c-a6d4ac67112d service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:51:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7de996d4-d541-4d6f-a347-5a18f425e138 req-caaa696d-2d94-48cc-b07c-a6d4ac67112d service nova] Acquiring lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7de996d4-d541-4d6f-a347-5a18f425e138 req-caaa696d-2d94-48cc-b07c-a6d4ac67112d service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7de996d4-d541-4d6f-a347-5a18f425e138 req-caaa696d-2d94-48cc-b07c-a6d4ac67112d service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-7de996d4-d541-4d6f-a347-5a18f425e138 req-caaa696d-2d94-48cc-b07c-a6d4ac67112d service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] No waiting events found dispatching network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:51:33 user nova-compute[75826]: WARNING nova.compute.manager [req-7de996d4-d541-4d6f-a347-5a18f425e138 req-caaa696d-2d94-48cc-b07c-a6d4ac67112d service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received unexpected event network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba for instance with vm_state active and task_state shelving_image_uploading.
Nov 16 00:51:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:35 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Snapshot image upload complete
Nov 16 00:51:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:51:35 user nova-compute[75826]: INFO nova.compute.manager [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Shelve offloading
Nov 16 00:51:35 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Instance destroyed successfully.
Nov 16 00:51:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:51:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:51:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquired lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:51:35 user nova-compute[75826]: DEBUG nova.network.neutron [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:51:36 user nova-compute[75826]: DEBUG nova.network.neutron [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Updating instance_info_cache with network_info: [{"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:51:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Releasing lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:51:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Instance destroyed successfully.
Nov 16 00:51:37 user nova-compute[75826]: DEBUG nova.objects.instance [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'resources' on Instance uuid cb8a1a92-10de-4bdc-b730-83bae29ff92b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:49:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1266665264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1266665264',id=30,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkKOKHpjmxVwP9V7adtdz4VQBjXn7APViT1VzpK4o4RhMiapzvLBqHFVkjHnA+c0rjxqezFUAS25kHTzDm+npNVmmZXmRGAI3ibU+T6quMQQhJNAm2BD/LbwCTKFPZM3A==',key_name='tempest-keypair-1217439759',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c770637392a544c48a72c953bfd9e7c6',ramdisk_id='',reservation_id='r-ip881mu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849437325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849437325-project-member',shelved_at='2023-11-16T00:51:35.822001',shelved_host='user',shelved_image_id='53eb5b79-49e2-4115-943a-4736eec6327b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:51:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a858d73834524c86a1c5c8514270761e',uuid=cb8a1a92-10de-4bdc-b730-83bae29ff92b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converting VIF {"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG os_vif [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c4ad1d8-e2, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG nova.compute.manager [req-4f536f2a-3925-4e35-81dd-ae09a74ec0b3 req-a036d60d-9ee5-4a22-8e3f-5bb93501d7f4 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-changed-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG nova.compute.manager [req-4f536f2a-3925-4e35-81dd-ae09a74ec0b3 req-a036d60d-9ee5-4a22-8e3f-5bb93501d7f4 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Refreshing instance network info cache due to event network-changed-5c4ad1d8-e2df-47a7-9305-538ad370dfba. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4f536f2a-3925-4e35-81dd-ae09a74ec0b3 req-a036d60d-9ee5-4a22-8e3f-5bb93501d7f4 service nova] Acquiring lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4f536f2a-3925-4e35-81dd-ae09a74ec0b3 req-a036d60d-9ee5-4a22-8e3f-5bb93501d7f4 service nova] Acquired lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG nova.network.neutron [req-4f536f2a-3925-4e35-81dd-ae09a74ec0b3 req-a036d60d-9ee5-4a22-8e3f-5bb93501d7f4 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Refreshing network info cache for port 5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4018b4ec-46e5-46df-bb1d-b125877090c8) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:51:37 user nova-compute[75826]: INFO os_vif [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2')
Nov 16 00:51:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Deleting instance files /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b_del
Nov 16 00:51:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Deletion of /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b_del complete
Nov 16 00:51:37 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Deleted allocations for instance cb8a1a92-10de-4bdc-b730-83bae29ff92b
Nov 16 00:51:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG nova.objects.instance [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'numa_topology' on Instance uuid cb8a1a92-10de-4bdc-b730-83bae29ff92b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG nova.objects.base [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Object Instance<cb8a1a92-10de-4bdc-b730-83bae29ff92b> lazy-loaded attributes: resources,numa_topology {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.599s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-469b662d-6cf7-416c-96cd-8ccdf152aa4b tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.384s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:37 user nova-compute[75826]: DEBUG nova.network.neutron [req-4f536f2a-3925-4e35-81dd-ae09a74ec0b3 req-a036d60d-9ee5-4a22-8e3f-5bb93501d7f4 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Updated VIF entry in instance network info cache for port 5c4ad1d8-e2df-47a7-9305-538ad370dfba. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:51:38 user nova-compute[75826]: DEBUG nova.network.neutron [req-4f536f2a-3925-4e35-81dd-ae09a74ec0b3 req-a036d60d-9ee5-4a22-8e3f-5bb93501d7f4 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Updating instance_info_cache with network_info: [{"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:51:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4f536f2a-3925-4e35-81dd-ae09a74ec0b3 req-a036d60d-9ee5-4a22-8e3f-5bb93501d7f4 service nova] Releasing lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:51:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:56 user nova-compute[75826]: INFO nova.compute.manager [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Terminating instance
Nov 16 00:51:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:51:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-cb1fa21d-1584-4ad6-ba98-2d293b9b0ca1 req-f1adda84-0c8a-4dcc-9256-e0ae7fd1cca7 service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Received event network-vif-unplugged-20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-cb1fa21d-1584-4ad6-ba98-2d293b9b0ca1 req-f1adda84-0c8a-4dcc-9256-e0ae7fd1cca7 service nova] Acquiring lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-cb1fa21d-1584-4ad6-ba98-2d293b9b0ca1 req-f1adda84-0c8a-4dcc-9256-e0ae7fd1cca7 service nova] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-cb1fa21d-1584-4ad6-ba98-2d293b9b0ca1 req-f1adda84-0c8a-4dcc-9256-e0ae7fd1cca7 service nova] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-cb1fa21d-1584-4ad6-ba98-2d293b9b0ca1 req-f1adda84-0c8a-4dcc-9256-e0ae7fd1cca7 service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] No waiting events found dispatching network-vif-unplugged-20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-cb1fa21d-1584-4ad6-ba98-2d293b9b0ca1 req-f1adda84-0c8a-4dcc-9256-e0ae7fd1cca7 service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Received event network-vif-unplugged-20542643-dc4b-4716-bf96-31e9bbd727e1 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:51:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Instance destroyed successfully.
Nov 16 00:51:57 user nova-compute[75826]: DEBUG nova.objects.instance [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'resources' on Instance uuid b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:46:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-76035410',display_name='tempest-AttachVolumeNegativeTest-server-76035410',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-76035410',id=23,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnLU67ji+IH97B3T2sH00GLwc0CK8bTpeZKm7tnoqbCn+8nMjfkOIuzXpH7GqA4zMxY28R7GzpgDvnFFEiI6XjbOv8468tyX7sqMsN+0k0nr1MfahNO8Pi78kkijWYoHw==',key_name='tempest-keypair-925187123',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:46:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13ad3ee3a8e04d728243e886a1460cae',ramdisk_id='',reservation_id='r-wjlms705',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-471555798',owner_user_name='tempest-AttachVolumeNegativeTest-471555798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:46:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e2d1a7cea414446842b5abfc9fe93de',uuid=b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20542643-dc4b-4716-bf96-31e9bbd727e1", "address": "fa:16:3e:98:06:9c", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20542643-dc", "ovs_interfaceid": "20542643-dc4b-4716-bf96-31e9bbd727e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converting VIF {"id": "20542643-dc4b-4716-bf96-31e9bbd727e1", "address": "fa:16:3e:98:06:9c", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.165", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20542643-dc", "ovs_interfaceid": "20542643-dc4b-4716-bf96-31e9bbd727e1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:06:9c,bridge_name='br-int',has_traffic_filtering=True,id=20542643-dc4b-4716-bf96-31e9bbd727e1,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20542643-dc') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG os_vif [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:06:9c,bridge_name='br-int',has_traffic_filtering=True,id=20542643-dc4b-4716-bf96-31e9bbd727e1,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20542643-dc') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20542643-dc, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=04a7730f-fafe-4616-8e2a-273dbae3610d) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:51:57 user nova-compute[75826]: INFO os_vif [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:06:9c,bridge_name='br-int',has_traffic_filtering=True,id=20542643-dc4b-4716-bf96-31e9bbd727e1,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20542643-dc')
Nov 16 00:51:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Deleting instance files /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8_del
Nov 16 00:51:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Deletion of /opt/stack/data/nova/instances/b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8_del complete
Nov 16 00:51:57 user nova-compute[75826]: INFO nova.compute.manager [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 16 00:51:57 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:51:57 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:51:58 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:51:58 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Took 0.65 seconds to deallocate network for instance.
Nov 16 00:51:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:58 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:51:58 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:51:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:58 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Deleted allocations for instance b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8
Nov 16 00:51:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ab835abd-4eb3-4c85-814e-113f8f48aa99 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.161s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-41af4926-2485-4daf-9b9e-d891e0cada00 req-61797ccb-cc06-4ad6-807d-55747097d8c5 service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Received event network-vif-plugged-20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:51:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-41af4926-2485-4daf-9b9e-d891e0cada00 req-61797ccb-cc06-4ad6-807d-55747097d8c5 service nova] Acquiring lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:51:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-41af4926-2485-4daf-9b9e-d891e0cada00 req-61797ccb-cc06-4ad6-807d-55747097d8c5 service nova] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:51:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-41af4926-2485-4daf-9b9e-d891e0cada00 req-61797ccb-cc06-4ad6-807d-55747097d8c5 service nova] Lock "b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:51:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-41af4926-2485-4daf-9b9e-d891e0cada00 req-61797ccb-cc06-4ad6-807d-55747097d8c5 service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] No waiting events found dispatching network-vif-plugged-20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:51:59 user nova-compute[75826]: WARNING nova.compute.manager [req-41af4926-2485-4daf-9b9e-d891e0cada00 req-61797ccb-cc06-4ad6-807d-55747097d8c5 service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Received unexpected event network-vif-plugged-20542643-dc4b-4716-bf96-31e9bbd727e1 for instance with vm_state deleted and task_state None.
Nov 16 00:51:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-41af4926-2485-4daf-9b9e-d891e0cada00 req-61797ccb-cc06-4ad6-807d-55747097d8c5 service nova] [instance: b7f8ef2c-f486-4d87-9b36-3b89dd44c7b8] Received event network-vif-deleted-20542643-dc4b-4716-bf96-31e9bbd727e1 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:51:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:52:02 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:52:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updating instance_info_cache with network_info: [{"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:04 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:52:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:52:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:52:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:52:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:08 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:52:08 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7469MB free_disk=25.214595794677734GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 298c8986-b91b-4f46-bcce-75e28bc02b5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 87b2703e-0154-445e-b659-5f5cf1d9f8f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance cc77d9aa-4052-40dd-9495-3a516d8f0793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 38a96872-51b5-448d-83c8-f722520d128c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 34bed458-5248-473d-b022-7f953669d85c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 1a8d5a29-7f30-4c80-8e49-32081a514b2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:52:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:52:09 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:52:09 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:52:09 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:52:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.461s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:52:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:52:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:52:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:52:11 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:52:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:52:13 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:52:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:52:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:52:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-89e3e51b-3603-4949-b721-184a21306af8 req-48784f42-32f6-452e-bcf0-bd68091ec100 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Received event network-changed-95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-89e3e51b-3603-4949-b721-184a21306af8 req-48784f42-32f6-452e-bcf0-bd68091ec100 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Refreshing instance network info cache due to event network-changed-95244a55-3c22-4eb7-ada5-7c20002f8728. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:52:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-89e3e51b-3603-4949-b721-184a21306af8 req-48784f42-32f6-452e-bcf0-bd68091ec100 service nova] Acquiring lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:52:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-89e3e51b-3603-4949-b721-184a21306af8 req-48784f42-32f6-452e-bcf0-bd68091ec100 service nova] Acquired lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:52:22 user nova-compute[75826]: DEBUG nova.network.neutron [req-89e3e51b-3603-4949-b721-184a21306af8 req-48784f42-32f6-452e-bcf0-bd68091ec100 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Refreshing network info cache for port 95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:52:23 user nova-compute[75826]: DEBUG nova.network.neutron [req-89e3e51b-3603-4949-b721-184a21306af8 req-48784f42-32f6-452e-bcf0-bd68091ec100 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updated VIF entry in instance network info cache for port 95244a55-3c22-4eb7-ada5-7c20002f8728. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:52:23 user nova-compute[75826]: DEBUG nova.network.neutron [req-89e3e51b-3603-4949-b721-184a21306af8 req-48784f42-32f6-452e-bcf0-bd68091ec100 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updating instance_info_cache with network_info: [{"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:52:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-89e3e51b-3603-4949-b721-184a21306af8 req-48784f42-32f6-452e-bcf0-bd68091ec100 service nova] Releasing lock "refresh_cache-ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:52:24 user nova-compute[75826]: DEBUG nova.compute.manager [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Stashing vm_state: active {{(pid=75826) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 16 00:52:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:24 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:52:24 user nova-compute[75826]: INFO nova.compute.claims [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Claim successful on node user
Nov 16 00:52:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-5bd56f50-d38c-473a-8256-e5e514a57070 req-0b6feb35-e10b-46aa-8081-3ca1e159460f service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received event network-changed-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-5bd56f50-d38c-473a-8256-e5e514a57070 req-0b6feb35-e10b-46aa-8081-3ca1e159460f service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Refreshing instance network info cache due to event network-changed-5aaa7f08-f7a2-4933-9667-b6e444930366. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:52:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5bd56f50-d38c-473a-8256-e5e514a57070 req-0b6feb35-e10b-46aa-8081-3ca1e159460f service nova] Acquiring lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:52:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5bd56f50-d38c-473a-8256-e5e514a57070 req-0b6feb35-e10b-46aa-8081-3ca1e159460f service nova] Acquired lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:52:24 user nova-compute[75826]: DEBUG nova.network.neutron [req-5bd56f50-d38c-473a-8256-e5e514a57070 req-0b6feb35-e10b-46aa-8081-3ca1e159460f service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Refreshing network info cache for port 5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:52:24 user nova-compute[75826]: INFO nova.compute.resource_tracker [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Updating resource usage from migration 58becfc1-af9d-40f4-89cf-7ba3023c6e7d
Nov 16 00:52:25 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:52:25 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:52:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.446s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:25 user nova-compute[75826]: INFO nova.compute.manager [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Migrating
Nov 16 00:52:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:52:25 user nova-compute[75826]: DEBUG nova.network.neutron [req-5bd56f50-d38c-473a-8256-e5e514a57070 req-0b6feb35-e10b-46aa-8081-3ca1e159460f service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Updated VIF entry in instance network info cache for port 5aaa7f08-f7a2-4933-9667-b6e444930366. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:52:25 user nova-compute[75826]: DEBUG nova.network.neutron [req-5bd56f50-d38c-473a-8256-e5e514a57070 req-0b6feb35-e10b-46aa-8081-3ca1e159460f service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Updating instance_info_cache with network_info: [{"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:52:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5bd56f50-d38c-473a-8256-e5e514a57070 req-0b6feb35-e10b-46aa-8081-3ca1e159460f service nova] Releasing lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:52:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquired lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:52:25 user nova-compute[75826]: DEBUG nova.network.neutron [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:52:25 user nova-compute[75826]: DEBUG nova.network.neutron [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Updating instance_info_cache with network_info: [{"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:52:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Releasing lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:52:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Starting migrate_disk_and_power_off {{(pid=75826) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 16 00:52:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:26 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Instance destroyed successfully.
Nov 16 00:52:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:50:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1176128372',display_name='tempest-ServerActionsTestOtherA-server-1176128372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1176128372',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcHp4MQ1nmnfoZHtG9WUM26rOqXSqM447yKb3OZbHurSNdmdHJlgSIOlTsu4HAYreZ++oluuNxFq/KteFOdGXtyepeTckkePgfQai5TpDlxusLQNPtiszvnX3ROIIcIMw==',key_name='tempest-keypair-2013094512',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:50:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-spmosdih',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:52:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=38a96872-51b5-448d-83c8-f722520d128c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-808749216-network", "vif_mac": "fa:16:3e:05:7b:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-808749216-network", "vif_mac": "fa:16:3e:05:7b:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_vif [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5aaa7f08-f7, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e8a11ea6-9056-4be3-baaf-b075ff8a9546) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:52:26 user nova-compute[75826]: INFO os_vif [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7')
Nov 16 00:52:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GoJBRfEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:52:26 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0a6f5b-6e16-44b6-889e-b987ebb3c8aa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:52:26 user nova-compute[75826]: No targets found.
Nov 16 00:52:26 user nova-compute[75826]: iSNS:
Nov 16 00:52:26 user nova-compute[75826]: No targets found.
Nov 16 00:52:26 user nova-compute[75826]: STATIC:
Nov 16 00:52:26 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc
Nov 16 00:52:26 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:52:26 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:52:26 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9
Nov 16 00:52:26 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:52:26 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:52:26 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:52:26 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:52:26 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:52:26 user nova-compute[75826]: FIRMWARE:
Nov 16 00:52:26 user nova-compute[75826]: No targets found.
Nov 16 00:52:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:52:26 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:52:26 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a928fd-f303-4827-a4f5-9e56fa0e2839]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b915e6a9-a6cb-4913-99f5-f1ed468ce219]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:52:26 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:52:26 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:52:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:52:26 user nova-compute[75826]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:52:26 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:52:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd94301b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9'): ({'sde'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Removing single pathed devices sde {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6391ec-4783-424e-a481-1f75b84772ee]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fdcb31-6aae-406b-85d1-8322bf40e240]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flushing IO for device /dev/sde {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6080a481-4452-4fab-a200-9521af8df23b]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-19800cdb-83a0-409b-826b-1fd71547e61f req-d6888749-9a8d-4cc2-a9e0-7561d106286b service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received event network-vif-unplugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-19800cdb-83a0-409b-826b-1fd71547e61f req-d6888749-9a8d-4cc2-a9e0-7561d106286b service nova] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-19800cdb-83a0-409b-826b-1fd71547e61f req-d6888749-9a8d-4cc2-a9e0-7561d106286b service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-19800cdb-83a0-409b-826b-1fd71547e61f req-d6888749-9a8d-4cc2-a9e0-7561d106286b service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-19800cdb-83a0-409b-826b-1fd71547e61f req-d6888749-9a8d-4cc2-a9e0-7561d106286b service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] No waiting events found dispatching network-vif-unplugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:26 user nova-compute[75826]: WARNING nova.compute.manager [req-19800cdb-83a0-409b-826b-1fd71547e61f req-d6888749-9a8d-4cc2-a9e0-7561d106286b service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received unexpected event network-vif-unplugged-5aaa7f08-f7a2-4933-9667-b6e444930366 for instance with vm_state active and task_state resize_migrating.
Nov 16 00:52:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-19800cdb-83a0-409b-826b-1fd71547e61f req-d6888749-9a8d-4cc2-a9e0-7561d106286b service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received event network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-19800cdb-83a0-409b-826b-1fd71547e61f req-d6888749-9a8d-4cc2-a9e0-7561d106286b service nova] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-19800cdb-83a0-409b-826b-1fd71547e61f req-d6888749-9a8d-4cc2-a9e0-7561d106286b service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-19800cdb-83a0-409b-826b-1fd71547e61f req-d6888749-9a8d-4cc2-a9e0-7561d106286b service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-19800cdb-83a0-409b-826b-1fd71547e61f req-d6888749-9a8d-4cc2-a9e0-7561d106286b service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] No waiting events found dispatching network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:26 user nova-compute[75826]: WARNING nova.compute.manager [req-19800cdb-83a0-409b-826b-1fd71547e61f req-d6888749-9a8d-4cc2-a9e0-7561d106286b service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received unexpected event network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 for instance with vm_state active and task_state resize_migrating.
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.056s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a99c2be-f905-4577-a9d6-4ccd930c5d15]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ccfbd4-a973-48f3-8bfa-e94da6d002bb]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8975e172-3ccf-4050-8fce-762225700c78]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260]
Nov 16 00:52:26 user nova-compute[75826]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260] successful.
Nov 16 00:52:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e1aa88-06f1-468e-923c-c81647fb54c3]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] <== disconnect_volume: return (336ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:52:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] skipping disk /dev/sde (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:52:27 user nova-compute[75826]: DEBUG nova.network.neutron [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Port 5aaa7f08-f7a2-4933-9667-b6e444930366 binding to destination host user is already ACTIVE {{(pid=75826) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquired lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG nova.network.neutron [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG nova.network.neutron [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Updating instance_info_cache with network_info: [{"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Releasing lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG os_brick.utils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e03b110-07a2-4450-8bb4-3d6da1976391]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f4ebaf-ecef-44a7-860b-9fc68c45a0f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7144add-b94f-4ba5-9180-6100610bc0ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dddc4a23-d178-4d3d-9763-bf1f67a19ace]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:52:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:52:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:52:29 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:52:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bc5572-96f0-4208-865f-37a9ab65715e]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:52:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:52:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:52:29 user nova-compute[75826]: DEBUG os_brick.utils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:52:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:30 user nova-compute[75826]: INFO nova.compute.manager [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Rescuing
Nov 16 00:52:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "refresh_cache-34bed458-5248-473d-b022-7f953669d85c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:52:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquired lock "refresh_cache-34bed458-5248-473d-b022-7f953669d85c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:52:30 user nova-compute[75826]: DEBUG nova.network.neutron [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:52:30 user nova-compute[75826]: DEBUG nova.network.neutron [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Updating instance_info_cache with network_info: [{"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:52:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Releasing lock "refresh_cache-34bed458-5248-473d-b022-7f953669d85c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:52:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:31 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 34bed458-5248-473d-b022-7f953669d85c] Instance destroyed successfully.
Nov 16 00:52:31 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Attempting a stable device rescue
Nov 16 00:52:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75826) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 00:52:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Instance directory exists: not creating {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 00:52:31 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Creating image(s)
Nov 16 00:52:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "/opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "/opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "/opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:31 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'trusted_certs' on Instance uuid 34bed458-5248-473d-b022-7f953669d85c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "da8fefc2106233aee4dbd15a93c8207cd1878c25" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "da8fefc2106233aee4dbd15a93c8207cd1878c25" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25.part --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25.part --force-share --output=json" returned: 0 in 0.185s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG nova.virt.images [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] ca89d1f5-f9e1-42dc-a621-e9b55f782612 was qcow2, converting to raw {{(pid=75826) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25.part /opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25.converted {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-111c95f1-1901-4b8e-b7d2-5b3d01aed47e req-0c162c37-f515-4f34-ab7c-ff379017e69e service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-unplugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-111c95f1-1901-4b8e-b7d2-5b3d01aed47e req-0c162c37-f515-4f34-ab7c-ff379017e69e service nova] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-111c95f1-1901-4b8e-b7d2-5b3d01aed47e req-0c162c37-f515-4f34-ab7c-ff379017e69e service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-111c95f1-1901-4b8e-b7d2-5b3d01aed47e req-0c162c37-f515-4f34-ab7c-ff379017e69e service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-111c95f1-1901-4b8e-b7d2-5b3d01aed47e req-0c162c37-f515-4f34-ab7c-ff379017e69e service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] No waiting events found dispatching network-vif-unplugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:33 user nova-compute[75826]: WARNING nova.compute.manager [req-111c95f1-1901-4b8e-b7d2-5b3d01aed47e req-0c162c37-f515-4f34-ab7c-ff379017e69e service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received unexpected event network-vif-unplugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e for instance with vm_state active and task_state rescuing.
Nov 16 00:52:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25.part /opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25.converted" returned: 0 in 0.482s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25.converted --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "da8fefc2106233aee4dbd15a93c8207cd1878c25" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.965s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "da8fefc2106233aee4dbd15a93c8207cd1878c25" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "da8fefc2106233aee4dbd15a93c8207cd1878c25" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25 --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25 --force-share --output=json" returned: 0 in 0.189s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25,backing_fmt=raw /opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.rescue {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25,backing_fmt=raw /opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.rescue" returned: 0 in 0.052s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "da8fefc2106233aee4dbd15a93c8207cd1878c25" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'migration_context' on Instance uuid 34bed458-5248-473d-b022-7f953669d85c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.objects.base [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Object Instance<34bed458-5248-473d-b022-7f953669d85c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Start _get_guest_xml network_info=[{"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "vif_mac": "fa:16:3e:52:f8:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ca89d1f5-f9e1-42dc-a621-e9b55f782612', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2edfc124-5c6d-4acc-999d-fdaf5c87365e', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDYTPtyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '34bed458-5248-473d-b022-7f953669d85c', 'attached_at': '', 'detached_at': '', 'volume_id': '8c80aed0-5e47-4143-8665-68f0fd5531bc', 'serial': '8c80aed0-5e47-4143-8665-68f0fd5531bc'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'resources' on Instance uuid 34bed458-5248-473d-b022-7f953669d85c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.objects.base [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Object Instance<34bed458-5248-473d-b022-7f953669d85c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'numa_topology' on Instance uuid 34bed458-5248-473d-b022-7f953669d85c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.objects.base [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Object Instance<34bed458-5248-473d-b022-7f953669d85c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:52:34 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:52:34 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'vcpu_model' on Instance uuid 34bed458-5248-473d-b022-7f953669d85c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.objects.base [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Object Instance<34bed458-5248-473d-b022-7f953669d85c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDYTPtyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:52:34 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:52:34 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:52:34 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0239e7-5762-4d2b-8e8b-70af91499319]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EDYTPtyH\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 00:52:34 user nova-compute[75826]: node.name = iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc
Nov 16 00:52:34 user nova-compute[75826]: node.tpgt = -1
Nov 16 00:52:34 user nova-compute[75826]: node.startup = automatic
Nov 16 00:52:34 user nova-compute[75826]: node.leading_login = No
Nov 16 00:52:34 user nova-compute[75826]: iface.iscsi_ifacename = default
Nov 16 00:52:34 user nova-compute[75826]: iface.net_ifacename = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.ipaddress = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.prefix_len = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.hwaddress = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.transport_name = tcp
Nov 16 00:52:34 user nova-compute[75826]: iface.initiatorname = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.state = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.vlan_id = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.vlan_priority = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.vlan_state = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.iface_num = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.mtu = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.port = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.bootproto = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.subnet_mask = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.gateway = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.dhcp_alt_client_id = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.dhcp_dns = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.dhcp_learn_iqn = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.dhcp_vendor_id_state = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.dhcp_vendor_id = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.dhcp_slp_da = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.fragmentation = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.gratuitous_arp = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.incoming_forwarding = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.tos_state = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.tos = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.ttl = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.delayed_ack = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.tcp_nagle = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.tcp_wsf_state = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.tcp_wsf = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.tcp_timer_scale = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.tcp_timestamp = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.redirect = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.def_task_mgmt_timeout = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.header_digest = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.data_digest = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.immediate_data = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.initial_r2t = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.data_seq_inorder = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.data_pdu_inorder = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.erl = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.max_receive_data_len = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.first_burst_len = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.max_outstanding_r2t = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.max_burst_len = 0
Nov 16 00:52:34 user nova-compute[75826]: iface.chap_auth = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.bidi_chap = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.strict_login_compliance = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.discovery_auth = <empty>
Nov 16 00:52:34 user nova-compute[75826]: iface.discovery_logout = <empty>
Nov 16 00:52:34 user nova-compute[75826]: node.discovery_address = <empty>
Nov 16 00:52:34 user nova-compute[75826]: node.discovery_port = 0
Nov 16 00:52:34 user nova-compute[75826]: node.discovery_type = static
Nov 16 00:52:34 user nova-compute[75826]: node.session.initial_cmdsn = 0
Nov 16 00:52:34 user nova-compute[75826]: node.session.initial_login_retry_max = 8
Nov 16 00:52:34 user nova-compute[75826]: node.session.xmit_thread_priority = -20
Nov 16 00:52:34 user nova-compute[75826]: node.session.cmds_max = 128
Nov 16 00:52:34 user nova-compute[75826]: node.session.queue_depth = 32
Nov 16 00:52:34 user nova-compute[75826]: node.session.nr_sessions = 1
Nov 16 00:52:34 user nova-compute[75826]: node.session.auth.authmethod = CHAP
Nov 16 00:52:34 user nova-compute[75826]: node.session.auth.username = EDYTPtyH
Nov 16 00:52:34 user nova-compute[75826]: node.session.auth.password = ***
Nov 16 00:52:34 user nova-compute[75826]: node.session.auth.username_in = <empty>
Nov 16 00:52:34 user nova-compute[75826]: node.session.auth.password_in = <empty>
Nov 16 00:52:34 user nova-compute[75826]: node.session.auth.chap_algs = MD5
Nov 16 00:52:34 user nova-compute[75826]: node.session.timeo.replacement_timeout = 120
Nov 16 00:52:34 user nova-compute[75826]: node.session.err_timeo.abort_timeout = 15
Nov 16 00:52:34 user nova-compute[75826]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 00:52:34 user nova-compute[75826]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 00:52:34 user nova-compute[75826]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 00:52:34 user nova-compute[75826]: node.session.iscsi.FastAbort = Yes
Nov 16 00:52:34 user nova-compute[75826]: node.session.iscsi.InitialR2T = No
Nov 16 00:52:34 user nova-compute[75826]: node.session.iscsi.ImmediateData = Yes
Nov 16 00:52:34 user nova-compute[75826]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 00:52:34 user nova-compute[75826]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 00:52:34 user nova-compute[75826]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 00:52:34 user nova-compute[75826]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 00:52:34 user nova-compute[75826]: node.session.iscsi.MaxConnections = 1
Nov 16 00:52:34 user nova-compute[75826]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 00:52:34 user nova-compute[75826]: node.session.iscsi.ERL = 0
Nov 16 00:52:34 user nova-compute[75826]: node.session.scan = manual
Nov 16 00:52:34 user nova-compute[75826]: node.session.reopen_max = 0
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].address = 172.16.0.220
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].port = 3260
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].startup = manual
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].tcp.window_size = 524288
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].tcp.type_of_service = 0
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].timeo.logout_timeout = 15
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].timeo.login_timeout = 15
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].timeo.auth_timeout = 45
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].iscsi.DataDigest = None
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].iscsi.IFMarker = No
Nov 16 00:52:34 user nova-compute[75826]: node.conn[0].iscsi.OFMarker = No
Nov 16 00:52:34 user nova-compute[75826]: # END RECORD
Nov 16 00:52:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Starting finish_migration {{(pid=75826) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Instance directory exists: not creating {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 00:52:34 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Creating image(s)
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Ensure instance console log exists: /opt/stack/data/nova/instances/38a96872-51b5-448d-83c8-f722520d128c/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Start _get_guest_xml network_info=[{"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-808749216-network", "vif_mac": "fa:16:3e:05:7b:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'e2a33a4f-0a43-4ce6-bc6e-7ca69117afa0', 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GoJBRfEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '38a96872-51b5-448d-83c8-f722520d128c', 'attached_at': '2023-11-16T00:52:34.000000', 'detached_at': '', 'volume_id': 'deaf5ba5-af12-408d-9a62-d905764b73e9', 'serial': 'deaf5ba5-af12-408d-9a62-d905764b73e9'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:52:34 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:52:34 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[65319d37-0f7f-4c63-adf1-f2556d0ec520]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:11Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GoJBRfEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:52:34 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6153c995-37fa-4543-80f8-5541050c2032]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EDYTPtyH {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EDYTPtyH" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9efb0cd5-8276-4642-8acc-bf4f646f8efe]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EDYTPtyH'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4461e8-1cf9-44bc-bc10-5ab44742a356]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9a3e80-0f67-4e29-93d2-e77912e8abce]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:52:34 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:52:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:52:34 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:52:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.167s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] HCTL ('37', '0', '0', 0) found on session 36 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b369f5-5420-4d2a-8891-91fd745ea261]: (4, ('0 0 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Searching for a device in session 36 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDYTPtyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.199s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] <== connect_volume: return (201ms) {'type': 'block', 'scsi_wwn': '23363636534656538', 'path': '/dev/sdf'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363636534656538', 'path': '/dev/sdf'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.105s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:52:34 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:52:34 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[34849264-c150-4032-9b0c-c570fa1944ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-576016767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-576016767',id=32,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:50:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-505msulp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:50:57Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=34bed458-5248-473d-b022-7f953669d85c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "vif_mac": "fa:16:3e:52:f8:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "vif_mac": "fa:16:3e:52:f8:ec"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:f8:ec,bridge_name='br-int',has_traffic_filtering=True,id=edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedccd7c6-eb') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'pci_devices' on Instance uuid 34bed458-5248-473d-b022-7f953669d85c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:52:34 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.objects.base [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Object Instance<34bed458-5248-473d-b022-7f953669d85c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:52:34 user nova-compute[75826]:   <uuid>34bed458-5248-473d-b022-7f953669d85c</uuid>
Nov 16 00:52:34 user nova-compute[75826]:   <name>instance-00000020</name>
Nov 16 00:52:34 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:52:34 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:52:34 user nova-compute[75826]:   <metadata>
Nov 16 00:52:34 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:52:34 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:52:34 user nova-compute[75826]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-576016767</nova:name>
Nov 16 00:52:34 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:52:34</nova:creationTime>
Nov 16 00:52:34 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:52:34 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:52:34 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:52:34 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:52:34 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:52:34 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:52:34 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:52:34 user nova-compute[75826]:       <nova:owner>
Nov 16 00:52:34 user nova-compute[75826]:         <nova:user uuid="f8606321461c403cbec7f0a36e454bc8">tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member</nova:user>
Nov 16 00:52:34 user nova-compute[75826]:         <nova:project uuid="e45c7fd936b74e109f83fc69060af216">tempest-ServerBootFromVolumeStableRescueTest-1116494461</nova:project>
Nov 16 00:52:34 user nova-compute[75826]:       </nova:owner>
Nov 16 00:52:34 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:52:34 user nova-compute[75826]:       <nova:ports>
Nov 16 00:52:34 user nova-compute[75826]:         <nova:port uuid="edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e">
Nov 16 00:52:34 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 00:52:34 user nova-compute[75826]:         </nova:port>
Nov 16 00:52:34 user nova-compute[75826]:       </nova:ports>
Nov 16 00:52:34 user nova-compute[75826]:     </nova:instance>
Nov 16 00:52:34 user nova-compute[75826]:   </metadata>
Nov 16 00:52:34 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:52:34 user nova-compute[75826]:     <system>
Nov 16 00:52:34 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:52:34 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:52:34 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:52:34 user nova-compute[75826]:       <entry name="serial">34bed458-5248-473d-b022-7f953669d85c</entry>
Nov 16 00:52:34 user nova-compute[75826]:       <entry name="uuid">34bed458-5248-473d-b022-7f953669d85c</entry>
Nov 16 00:52:34 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:52:34 user nova-compute[75826]:     </system>
Nov 16 00:52:34 user nova-compute[75826]:   </sysinfo>
Nov 16 00:52:34 user nova-compute[75826]:   <os>
Nov 16 00:52:34 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:52:34 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:52:34 user nova-compute[75826]:   </os>
Nov 16 00:52:34 user nova-compute[75826]:   <features>
Nov 16 00:52:34 user nova-compute[75826]:     <acpi/>
Nov 16 00:52:34 user nova-compute[75826]:     <apic/>
Nov 16 00:52:34 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:52:34 user nova-compute[75826]:   </features>
Nov 16 00:52:34 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:52:34 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:52:34 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:52:34 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:52:34 user nova-compute[75826]:   </clock>
Nov 16 00:52:34 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:52:34 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:52:34 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:52:34 user nova-compute[75826]:   </cpu>
Nov 16 00:52:34 user nova-compute[75826]:   <devices>
Nov 16 00:52:34 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:52:34 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:52:34 user nova-compute[75826]:       <source dev="/dev/sdf"/>
Nov 16 00:52:34 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:52:34 user nova-compute[75826]:       <serial>8c80aed0-5e47-4143-8665-68f0fd5531bc</serial>
Nov 16 00:52:34 user nova-compute[75826]:     </disk>
Nov 16 00:52:34 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:52:34 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:52:34 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.rescue"/>
Nov 16 00:52:34 user nova-compute[75826]:       <target dev="vdb" bus="virtio"/>
Nov 16 00:52:34 user nova-compute[75826]:       <boot order="1"/>
Nov 16 00:52:34 user nova-compute[75826]:     </disk>
Nov 16 00:52:34 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:52:34 user nova-compute[75826]:       <mac address="fa:16:3e:52:f8:ec"/>
Nov 16 00:52:34 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:52:34 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:52:34 user nova-compute[75826]:       <target dev="tapedccd7c6-eb"/>
Nov 16 00:52:34 user nova-compute[75826]:     </interface>
Nov 16 00:52:34 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:52:34 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/console.log" append="off"/>
Nov 16 00:52:34 user nova-compute[75826]:     </serial>
Nov 16 00:52:34 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:52:34 user nova-compute[75826]:     <video>
Nov 16 00:52:34 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:52:34 user nova-compute[75826]:     </video>
Nov 16 00:52:34 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:52:34 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:52:34 user nova-compute[75826]:     </rng>
Nov 16 00:52:34 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:52:34 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:52:34 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:52:34 user nova-compute[75826]:     </memballoon>
Nov 16 00:52:34 user nova-compute[75826]:   </devices>
Nov 16 00:52:34 user nova-compute[75826]: </domain>
Nov 16 00:52:34 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb6f006-cf19-4204-a121-6ed873d47d56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9] added
Nov 16 00:52:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 34bed458-5248-473d-b022-7f953669d85c] Instance destroyed successfully.
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b660677c-f2a1-4218-8637-9fd0ff8709d5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb0be49-fe3c-4fdc-a49f-0f75bd60a30c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GoJBRfEa {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] No VIF found with MAC fa:16:3e:52:f8:ec, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GoJBRfEa" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a284e5b-45de-4437-b3fc-6d06a3c88072]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GoJBRfEa'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fb9fa4-64ed-4dc5-9ebd-65a71b02166a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8413f8-e5a2-46a8-80a1-ab8eb32abdeb]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:52:34 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:52:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:52:34 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:52:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb917628-7e6b-490a-a84e-7d8272d6658a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260]
Nov 16 00:52:34 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260] successful.
Nov 16 00:52:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70467c4-eb64-46d2-94ee-6b847f2773e1]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd0be6a-b80b-4324-958c-8ecd2f7163d6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:52:34 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:52:34 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:52:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:52:34 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:52:34 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:52:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[30244795-e4cb-472d-af0a-52b7eb001735]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:52:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GoJBRfEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-bc06f95d-52fa-42e8-be9f-d2323ebdbdcc req-05dfe1dd-6de4-4bb0-baf7-e482773674fd service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bc06f95d-52fa-42e8-be9f-d2323ebdbdcc req-05dfe1dd-6de4-4bb0-baf7-e482773674fd service nova] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bc06f95d-52fa-42e8-be9f-d2323ebdbdcc req-05dfe1dd-6de4-4bb0-baf7-e482773674fd service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bc06f95d-52fa-42e8-be9f-d2323ebdbdcc req-05dfe1dd-6de4-4bb0-baf7-e482773674fd service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-bc06f95d-52fa-42e8-be9f-d2323ebdbdcc req-05dfe1dd-6de4-4bb0-baf7-e482773674fd service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] No waiting events found dispatching network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:35 user nova-compute[75826]: WARNING nova.compute.manager [req-bc06f95d-52fa-42e8-be9f-d2323ebdbdcc req-05dfe1dd-6de4-4bb0-baf7-e482773674fd service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received unexpected event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e for instance with vm_state active and task_state rescuing.
Nov 16 00:52:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26235633565663763', 'path': '/dev/sdc'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235633565663763', 'path': '/dev/sdc'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:50:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1176128372',display_name='tempest-ServerActionsTestOtherA-server-1176128372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1176128372',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcHp4MQ1nmnfoZHtG9WUM26rOqXSqM447yKb3OZbHurSNdmdHJlgSIOlTsu4HAYreZ++oluuNxFq/KteFOdGXtyepeTckkePgfQai5TpDlxusLQNPtiszvnX3ROIIcIMw==',key_name='tempest-keypair-2013094512',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:50:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-spmosdih',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:52:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=38a96872-51b5-448d-83c8-f722520d128c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-808749216-network", "vif_mac": "fa:16:3e:05:7b:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-808749216-network", "vif_mac": "fa:16:3e:05:7b:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:52:35 user nova-compute[75826]:   <uuid>38a96872-51b5-448d-83c8-f722520d128c</uuid>
Nov 16 00:52:35 user nova-compute[75826]:   <name>instance-0000001f</name>
Nov 16 00:52:35 user nova-compute[75826]:   <memory>2097152</memory>
Nov 16 00:52:35 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:52:35 user nova-compute[75826]:   <metadata>
Nov 16 00:52:35 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:52:35 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:52:35 user nova-compute[75826]:       <nova:name>tempest-ServerActionsTestOtherA-server-1176128372</nova:name>
Nov 16 00:52:35 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:52:34</nova:creationTime>
Nov 16 00:52:35 user nova-compute[75826]:       <nova:flavor name="m1.small">
Nov 16 00:52:35 user nova-compute[75826]:         <nova:memory>2048</nova:memory>
Nov 16 00:52:35 user nova-compute[75826]:         <nova:disk>20</nova:disk>
Nov 16 00:52:35 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:52:35 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:52:35 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:52:35 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:52:35 user nova-compute[75826]:       <nova:owner>
Nov 16 00:52:35 user nova-compute[75826]:         <nova:user uuid="055179a465cc4327b4ce68af5018608c">tempest-ServerActionsTestOtherA-329506797-project-member</nova:user>
Nov 16 00:52:35 user nova-compute[75826]:         <nova:project uuid="4d0d81c4b6d0415681092d61ea35de51">tempest-ServerActionsTestOtherA-329506797</nova:project>
Nov 16 00:52:35 user nova-compute[75826]:       </nova:owner>
Nov 16 00:52:35 user nova-compute[75826]:       <nova:ports>
Nov 16 00:52:35 user nova-compute[75826]:         <nova:port uuid="5aaa7f08-f7a2-4933-9667-b6e444930366">
Nov 16 00:52:35 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:52:35 user nova-compute[75826]:         </nova:port>
Nov 16 00:52:35 user nova-compute[75826]:       </nova:ports>
Nov 16 00:52:35 user nova-compute[75826]:     </nova:instance>
Nov 16 00:52:35 user nova-compute[75826]:   </metadata>
Nov 16 00:52:35 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:52:35 user nova-compute[75826]:     <system>
Nov 16 00:52:35 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:52:35 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:52:35 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:52:35 user nova-compute[75826]:       <entry name="serial">38a96872-51b5-448d-83c8-f722520d128c</entry>
Nov 16 00:52:35 user nova-compute[75826]:       <entry name="uuid">38a96872-51b5-448d-83c8-f722520d128c</entry>
Nov 16 00:52:35 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:52:35 user nova-compute[75826]:     </system>
Nov 16 00:52:35 user nova-compute[75826]:   </sysinfo>
Nov 16 00:52:35 user nova-compute[75826]:   <os>
Nov 16 00:52:35 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:52:35 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:52:35 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:52:35 user nova-compute[75826]:   </os>
Nov 16 00:52:35 user nova-compute[75826]:   <features>
Nov 16 00:52:35 user nova-compute[75826]:     <acpi/>
Nov 16 00:52:35 user nova-compute[75826]:     <apic/>
Nov 16 00:52:35 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:52:35 user nova-compute[75826]:   </features>
Nov 16 00:52:35 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:52:35 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:52:35 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:52:35 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:52:35 user nova-compute[75826]:   </clock>
Nov 16 00:52:35 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:52:35 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:52:35 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:52:35 user nova-compute[75826]:   </cpu>
Nov 16 00:52:35 user nova-compute[75826]:   <devices>
Nov 16 00:52:35 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:52:35 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:52:35 user nova-compute[75826]:       <source dev="/dev/sdc"/>
Nov 16 00:52:35 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:52:35 user nova-compute[75826]:       <serial>deaf5ba5-af12-408d-9a62-d905764b73e9</serial>
Nov 16 00:52:35 user nova-compute[75826]:     </disk>
Nov 16 00:52:35 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:52:35 user nova-compute[75826]:       <mac address="fa:16:3e:05:7b:62"/>
Nov 16 00:52:35 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:52:35 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:52:35 user nova-compute[75826]:       <target dev="tap5aaa7f08-f7"/>
Nov 16 00:52:35 user nova-compute[75826]:     </interface>
Nov 16 00:52:35 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:52:35 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/38a96872-51b5-448d-83c8-f722520d128c/console.log" append="off"/>
Nov 16 00:52:35 user nova-compute[75826]:     </serial>
Nov 16 00:52:35 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:52:35 user nova-compute[75826]:     <video>
Nov 16 00:52:35 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:52:35 user nova-compute[75826]:     </video>
Nov 16 00:52:35 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:52:35 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:52:35 user nova-compute[75826]:     </rng>
Nov 16 00:52:35 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:52:35 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:52:35 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:52:35 user nova-compute[75826]:     </memballoon>
Nov 16 00:52:35 user nova-compute[75826]:   </devices>
Nov 16 00:52:35 user nova-compute[75826]: </domain>
Nov 16 00:52:35 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:50:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1176128372',display_name='tempest-ServerActionsTestOtherA-server-1176128372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1176128372',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcHp4MQ1nmnfoZHtG9WUM26rOqXSqM447yKb3OZbHurSNdmdHJlgSIOlTsu4HAYreZ++oluuNxFq/KteFOdGXtyepeTckkePgfQai5TpDlxusLQNPtiszvnX3ROIIcIMw==',key_name='tempest-keypair-2013094512',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:50:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-spmosdih',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:52:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=38a96872-51b5-448d-83c8-f722520d128c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-808749216-network", "vif_mac": "fa:16:3e:05:7b:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-808749216-network", "vif_mac": "fa:16:3e:05:7b:62"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG os_vif [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60a811d5-893c-523a-a53b-6bf1c3330974', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5aaa7f08-f7, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5aaa7f08-f7, col_values=(('qos', UUID('3aef0f25-8cd0-43a8-bde0-cc321ffacf9f')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5aaa7f08-f7, col_values=(('external_ids', {'iface-id': '5aaa7f08-f7a2-4933-9667-b6e444930366', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:7b:62', 'vm-uuid': '38a96872-51b5-448d-83c8-f722520d128c'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:35 user nova-compute[75826]: INFO os_vif [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7')
Nov 16 00:52:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:52:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] No VIF found with MAC fa:16:3e:05:7b:62, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:52:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:36 user nova-compute[75826]: INFO nova.compute.manager [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Terminating instance
Nov 16 00:52:36 user nova-compute[75826]: DEBUG nova.compute.manager [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:52:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Instance destroyed successfully.
Nov 16 00:52:37 user nova-compute[75826]: DEBUG nova.objects.instance [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lazy-loading 'resources' on Instance uuid 1a8d5a29-7f30-4c80-8e49-32081a514b2c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-269779050',display_name='tempest-ServersNegativeTestJSON-server-269779050',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-269779050',id=33,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:50:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='328112cf55d04d8c8bb1b9d5655a2115',ramdisk_id='',reservation_id='r-rrgvs0mb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1135241657',owner_user_name='tempest-ServersNegativeTestJSON-1135241657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:50:53Z,user_data=None,user_id='d7ea010b69874f3eb8947e93531e6669',uuid=1a8d5a29-7f30-4c80-8e49-32081a514b2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "address": "fa:16:3e:e7:2e:6c", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b89ef46-36", "ovs_interfaceid": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Converting VIF {"id": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "address": "fa:16:3e:e7:2e:6c", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b89ef46-36", "ovs_interfaceid": "7b89ef46-36c9-467e-8452-1f9033c3b5b9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=7b89ef46-36c9-467e-8452-1f9033c3b5b9,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b89ef46-36') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG os_vif [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=7b89ef46-36c9-467e-8452-1f9033c3b5b9,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b89ef46-36') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b89ef46-36, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=827e9e02-587f-488e-ba59-ace7606bcf52) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: INFO os_vif [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:2e:6c,bridge_name='br-int',has_traffic_filtering=True,id=7b89ef46-36c9-467e-8452-1f9033c3b5b9,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b89ef46-36')
Nov 16 00:52:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Deleting instance files /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c_del
Nov 16 00:52:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Deletion of /opt/stack/data/nova/instances/1a8d5a29-7f30-4c80-8e49-32081a514b2c_del complete
Nov 16 00:52:37 user nova-compute[75826]: INFO nova.compute.manager [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 16 00:52:37 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:37 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:52:38 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Took 0.54 seconds to deallocate network for instance.
Nov 16 00:52:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-8d98ae4f-816b-4043-9f30-7efa7ca08a1a req-6fdc7e9b-e7db-4940-90ed-49bd16129622 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Received event network-vif-deleted-7b89ef46-36c9-467e-8452-1f9033c3b5b9 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:38 user nova-compute[75826]: INFO nova.compute.manager [req-8d98ae4f-816b-4043-9f30-7efa7ca08a1a req-6fdc7e9b-e7db-4940-90ed-49bd16129622 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Neutron deleted interface 7b89ef46-36c9-467e-8452-1f9033c3b5b9; detaching it from the instance and deleting it from the info cache
Nov 16 00:52:38 user nova-compute[75826]: DEBUG nova.network.neutron [req-8d98ae4f-816b-4043-9f30-7efa7ca08a1a req-6fdc7e9b-e7db-4940-90ed-49bd16129622 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:52:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-8d98ae4f-816b-4043-9f30-7efa7ca08a1a req-6fdc7e9b-e7db-4940-90ed-49bd16129622 service nova] [instance: 1a8d5a29-7f30-4c80-8e49-32081a514b2c] Detach interface failed, port_id=7b89ef46-36c9-467e-8452-1f9033c3b5b9, reason: Instance 1a8d5a29-7f30-4c80-8e49-32081a514b2c could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:52:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:38 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:52:38 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:52:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:38 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Deleted allocations for instance 1a8d5a29-7f30-4c80-8e49-32081a514b2c
Nov 16 00:52:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1bf6fe53-4e66-482f-91f7-4a919304b49f tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "1a8d5a29-7f30-4c80-8e49-32081a514b2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.231s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-e6288536-9c49-4bfb-80d0-b527c46eb829 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:52:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:52:39 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Instance running successfully.
Nov 16 00:52:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Failed to set time: agent not configured {{(pid=75826) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 16 00:52:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-76ff08c5-87fa-41ac-8bf7-ddd4a65eb99b tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] finish_migration finished successfully. {{(pid=75826) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 16 00:52:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-409271d1-6d52-4d3f-add8-64ea51dd586c req-d62936a1-b0cb-496c-af49-ce701af92df0 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-409271d1-6d52-4d3f-add8-64ea51dd586c req-d62936a1-b0cb-496c-af49-ce701af92df0 service nova] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-409271d1-6d52-4d3f-add8-64ea51dd586c req-d62936a1-b0cb-496c-af49-ce701af92df0 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-409271d1-6d52-4d3f-add8-64ea51dd586c req-d62936a1-b0cb-496c-af49-ce701af92df0 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-409271d1-6d52-4d3f-add8-64ea51dd586c req-d62936a1-b0cb-496c-af49-ce701af92df0 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] No waiting events found dispatching network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:40 user nova-compute[75826]: WARNING nova.compute.manager [req-409271d1-6d52-4d3f-add8-64ea51dd586c req-d62936a1-b0cb-496c-af49-ce701af92df0 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received unexpected event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e for instance with vm_state rescued and task_state None.
Nov 16 00:52:40 user nova-compute[75826]: INFO nova.compute.manager [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Rescuing
Nov 16 00:52:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:52:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquired lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:52:40 user nova-compute[75826]: DEBUG nova.network.neutron [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG nova.network.neutron [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Updating instance_info_cache with network_info: [{"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Releasing lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:41 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Instance destroyed successfully.
Nov 16 00:52:41 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Attempting rescue
Nov 16 00:52:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75826) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Instance directory exists: not creating {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 00:52:41 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Creating image(s)
Nov 16 00:52:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "/opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "/opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "/opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'trusted_certs' on Instance uuid 574817b0-a25c-4da1-9ce6-804008e8279c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.195s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.rescue {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.rescue" returned: 0 in 0.056s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'migration_context' on Instance uuid 574817b0-a25c-4da1-9ce6-804008e8279c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.objects.base [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<574817b0-a25c-4da1-9ce6-804008e8279c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Start _get_guest_xml network_info=[{"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "vif_mac": "fa:16:3e:03:09:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'resources' on Instance uuid 574817b0-a25c-4da1-9ce6-804008e8279c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.objects.base [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<574817b0-a25c-4da1-9ce6-804008e8279c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'numa_topology' on Instance uuid 574817b0-a25c-4da1-9ce6-804008e8279c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.objects.base [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<574817b0-a25c-4da1-9ce6-804008e8279c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:52:42 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:52:42 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'vcpu_model' on Instance uuid 574817b0-a25c-4da1-9ce6-804008e8279c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.objects.base [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<574817b0-a25c-4da1-9ce6-804008e8279c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:47:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-590900198',display_name='tempest-ServerRescueNegativeTestJSON-server-590900198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-590900198',id=25,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:48:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c7dc71f0e2f439f9944bd7410db7e08',ramdisk_id='',reservation_id='r-0dmt5wwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2102246851',owner_user_name='tempest-ServerRescueNegativeTestJSON-2102246851-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:48:04Z,user_data=None,user_id='923da525ba264ea4bf770e3a66319655',uuid=574817b0-a25c-4da1-9ce6-804008e8279c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "vif_mac": "fa:16:3e:03:09:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converting VIF {"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "vif_mac": "fa:16:3e:03:09:38"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:09:38,bridge_name='br-int',has_traffic_filtering=True,id=c7936822-0ba8-4241-9e2b-1977e21eba80,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7936822-0b') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'pci_devices' on Instance uuid 574817b0-a25c-4da1-9ce6-804008e8279c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.objects.base [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<574817b0-a25c-4da1-9ce6-804008e8279c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:52:42 user nova-compute[75826]:   <uuid>574817b0-a25c-4da1-9ce6-804008e8279c</uuid>
Nov 16 00:52:42 user nova-compute[75826]:   <name>instance-00000019</name>
Nov 16 00:52:42 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:52:42 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:52:42 user nova-compute[75826]:   <metadata>
Nov 16 00:52:42 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:52:42 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:52:42 user nova-compute[75826]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-590900198</nova:name>
Nov 16 00:52:42 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:52:42</nova:creationTime>
Nov 16 00:52:42 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:52:42 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:52:42 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:52:42 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:52:42 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:52:42 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:52:42 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:52:42 user nova-compute[75826]:       <nova:owner>
Nov 16 00:52:42 user nova-compute[75826]:         <nova:user uuid="923da525ba264ea4bf770e3a66319655">tempest-ServerRescueNegativeTestJSON-2102246851-project-member</nova:user>
Nov 16 00:52:42 user nova-compute[75826]:         <nova:project uuid="5c7dc71f0e2f439f9944bd7410db7e08">tempest-ServerRescueNegativeTestJSON-2102246851</nova:project>
Nov 16 00:52:42 user nova-compute[75826]:       </nova:owner>
Nov 16 00:52:42 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:52:42 user nova-compute[75826]:       <nova:ports>
Nov 16 00:52:42 user nova-compute[75826]:         <nova:port uuid="c7936822-0ba8-4241-9e2b-1977e21eba80">
Nov 16 00:52:42 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 00:52:42 user nova-compute[75826]:         </nova:port>
Nov 16 00:52:42 user nova-compute[75826]:       </nova:ports>
Nov 16 00:52:42 user nova-compute[75826]:     </nova:instance>
Nov 16 00:52:42 user nova-compute[75826]:   </metadata>
Nov 16 00:52:42 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:52:42 user nova-compute[75826]:     <system>
Nov 16 00:52:42 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:52:42 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:52:42 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:52:42 user nova-compute[75826]:       <entry name="serial">574817b0-a25c-4da1-9ce6-804008e8279c</entry>
Nov 16 00:52:42 user nova-compute[75826]:       <entry name="uuid">574817b0-a25c-4da1-9ce6-804008e8279c</entry>
Nov 16 00:52:42 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:52:42 user nova-compute[75826]:     </system>
Nov 16 00:52:42 user nova-compute[75826]:   </sysinfo>
Nov 16 00:52:42 user nova-compute[75826]:   <os>
Nov 16 00:52:42 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:52:42 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:52:42 user nova-compute[75826]:   </os>
Nov 16 00:52:42 user nova-compute[75826]:   <features>
Nov 16 00:52:42 user nova-compute[75826]:     <acpi/>
Nov 16 00:52:42 user nova-compute[75826]:     <apic/>
Nov 16 00:52:42 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:52:42 user nova-compute[75826]:   </features>
Nov 16 00:52:42 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:52:42 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:52:42 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:52:42 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:52:42 user nova-compute[75826]:   </clock>
Nov 16 00:52:42 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:52:42 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:52:42 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:52:42 user nova-compute[75826]:   </cpu>
Nov 16 00:52:42 user nova-compute[75826]:   <devices>
Nov 16 00:52:42 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:52:42 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:52:42 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.rescue"/>
Nov 16 00:52:42 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:52:42 user nova-compute[75826]:     </disk>
Nov 16 00:52:42 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:52:42 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:52:42 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk"/>
Nov 16 00:52:42 user nova-compute[75826]:       <target dev="vdb" bus="virtio"/>
Nov 16 00:52:42 user nova-compute[75826]:     </disk>
Nov 16 00:52:42 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:52:42 user nova-compute[75826]:       <mac address="fa:16:3e:03:09:38"/>
Nov 16 00:52:42 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:52:42 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:52:42 user nova-compute[75826]:       <target dev="tapc7936822-0b"/>
Nov 16 00:52:42 user nova-compute[75826]:     </interface>
Nov 16 00:52:42 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:52:42 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/console.log" append="off"/>
Nov 16 00:52:42 user nova-compute[75826]:     </serial>
Nov 16 00:52:42 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:52:42 user nova-compute[75826]:     <video>
Nov 16 00:52:42 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:52:42 user nova-compute[75826]:     </video>
Nov 16 00:52:42 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:52:42 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:52:42 user nova-compute[75826]:     </rng>
Nov 16 00:52:42 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:52:42 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:52:42 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:52:42 user nova-compute[75826]:     </memballoon>
Nov 16 00:52:42 user nova-compute[75826]:   </devices>
Nov 16 00:52:42 user nova-compute[75826]: </domain>
Nov 16 00:52:42 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:52:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Instance destroyed successfully.
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No VIF found with MAC fa:16:3e:03:09:38, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] No waiting events found dispatching network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:42 user nova-compute[75826]: WARNING nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received unexpected event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e for instance with vm_state rescued and task_state None.
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received event network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] No waiting events found dispatching network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:42 user nova-compute[75826]: WARNING nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received unexpected event network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 for instance with vm_state resized and task_state None.
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received event network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] No waiting events found dispatching network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:42 user nova-compute[75826]: WARNING nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received unexpected event network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 for instance with vm_state resized and task_state None.
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-unplugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] No waiting events found dispatching network-vif-unplugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:42 user nova-compute[75826]: WARNING nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received unexpected event network-vif-unplugged-c7936822-0ba8-4241-9e2b-1977e21eba80 for instance with vm_state active and task_state rescuing.
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] No waiting events found dispatching network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:42 user nova-compute[75826]: WARNING nova.compute.manager [req-1dd5d401-a357-4302-9d81-848724f8d348 req-6bb861da-dc92-4e6c-a740-cb2290fbb825 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received unexpected event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 for instance with vm_state active and task_state rescuing.
Nov 16 00:52:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:43 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:52:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:43 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:52:43 user nova-compute[75826]: INFO nova.compute.claims [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Claim successful on node user
Nov 16 00:52:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:43 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.822s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:52:44 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:52:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:52:44 user nova-compute[75826]: INFO nova.virt.block_device [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Booting with volume snapshot 9b0feb2d-3151-402e-b4ce-e8e5a234f617 at /dev/vda
Nov 16 00:52:44 user nova-compute[75826]: DEBUG nova.policy [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c17265442bc48f9b6de5367e91096b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4135693756414fb70826b0f1d9345c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-072ceeef-8fa5-4336-b21a-5d7095ebdfe6 req-7928e78c-a7ba-4025-9d7c-41748f732256 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-072ceeef-8fa5-4336-b21a-5d7095ebdfe6 req-7928e78c-a7ba-4025-9d7c-41748f732256 service nova] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-072ceeef-8fa5-4336-b21a-5d7095ebdfe6 req-7928e78c-a7ba-4025-9d7c-41748f732256 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-072ceeef-8fa5-4336-b21a-5d7095ebdfe6 req-7928e78c-a7ba-4025-9d7c-41748f732256 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-072ceeef-8fa5-4336-b21a-5d7095ebdfe6 req-7928e78c-a7ba-4025-9d7c-41748f732256 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] No waiting events found dispatching network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:44 user nova-compute[75826]: WARNING nova.compute.manager [req-072ceeef-8fa5-4336-b21a-5d7095ebdfe6 req-7928e78c-a7ba-4025-9d7c-41748f732256 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received unexpected event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 for instance with vm_state active and task_state rescuing.
Nov 16 00:52:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-072ceeef-8fa5-4336-b21a-5d7095ebdfe6 req-7928e78c-a7ba-4025-9d7c-41748f732256 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-072ceeef-8fa5-4336-b21a-5d7095ebdfe6 req-7928e78c-a7ba-4025-9d7c-41748f732256 service nova] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-072ceeef-8fa5-4336-b21a-5d7095ebdfe6 req-7928e78c-a7ba-4025-9d7c-41748f732256 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-072ceeef-8fa5-4336-b21a-5d7095ebdfe6 req-7928e78c-a7ba-4025-9d7c-41748f732256 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-072ceeef-8fa5-4336-b21a-5d7095ebdfe6 req-7928e78c-a7ba-4025-9d7c-41748f732256 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] No waiting events found dispatching network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:44 user nova-compute[75826]: WARNING nova.compute.manager [req-072ceeef-8fa5-4336-b21a-5d7095ebdfe6 req-7928e78c-a7ba-4025-9d7c-41748f732256 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received unexpected event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 for instance with vm_state active and task_state rescuing.
Nov 16 00:52:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:45 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Successfully created port: a0c420ba-1f56-4b44-ac55-73a89368402b {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:52:45 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Successfully updated port: a0c420ba-1f56-4b44-ac55-73a89368402b {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:52:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "refresh_cache-013ad5ba-e918-4c6a-8ece-33b6e11e5e40" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:52:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquired lock "refresh_cache-013ad5ba-e918-4c6a-8ece-33b6e11e5e40" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:52:45 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:52:45 user nova-compute[75826]: DEBUG nova.compute.manager [req-e8a32fe0-f2c4-4a6c-b30e-4d4f7a66b228 req-7a357d4b-a12d-459a-a50b-d20f7bf54749 service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Received event network-changed-a0c420ba-1f56-4b44-ac55-73a89368402b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:45 user nova-compute[75826]: DEBUG nova.compute.manager [req-e8a32fe0-f2c4-4a6c-b30e-4d4f7a66b228 req-7a357d4b-a12d-459a-a50b-d20f7bf54749 service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Refreshing instance network info cache due to event network-changed-a0c420ba-1f56-4b44-ac55-73a89368402b. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:52:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e8a32fe0-f2c4-4a6c-b30e-4d4f7a66b228 req-7a357d4b-a12d-459a-a50b-d20f7bf54749 service nova] Acquiring lock "refresh_cache-013ad5ba-e918-4c6a-8ece-33b6e11e5e40" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:52:45 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:52:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-e7db6f24-2a01-441d-bbc9-ecf08bd63923 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:52:46 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Updating instance_info_cache with network_info: [{"id": "a0c420ba-1f56-4b44-ac55-73a89368402b", "address": "fa:16:3e:32:c6:81", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c420ba-1f", "ovs_interfaceid": "a0c420ba-1f56-4b44-ac55-73a89368402b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:52:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Releasing lock "refresh_cache-013ad5ba-e918-4c6a-8ece-33b6e11e5e40" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:52:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Instance network_info: |[{"id": "a0c420ba-1f56-4b44-ac55-73a89368402b", "address": "fa:16:3e:32:c6:81", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c420ba-1f", "ovs_interfaceid": "a0c420ba-1f56-4b44-ac55-73a89368402b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:52:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e8a32fe0-f2c4-4a6c-b30e-4d4f7a66b228 req-7a357d4b-a12d-459a-a50b-d20f7bf54749 service nova] Acquired lock "refresh_cache-013ad5ba-e918-4c6a-8ece-33b6e11e5e40" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:52:46 user nova-compute[75826]: DEBUG nova.network.neutron [req-e8a32fe0-f2c4-4a6c-b30e-4d4f7a66b228 req-7a357d4b-a12d-459a-a50b-d20f7bf54749 service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Refreshing network info cache for port a0c420ba-1f56-4b44-ac55-73a89368402b {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:52:46 user nova-compute[75826]: DEBUG nova.network.neutron [req-e8a32fe0-f2c4-4a6c-b30e-4d4f7a66b228 req-7a357d4b-a12d-459a-a50b-d20f7bf54749 service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Updated VIF entry in instance network info cache for port a0c420ba-1f56-4b44-ac55-73a89368402b. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:52:46 user nova-compute[75826]: DEBUG nova.network.neutron [req-e8a32fe0-f2c4-4a6c-b30e-4d4f7a66b228 req-7a357d4b-a12d-459a-a50b-d20f7bf54749 service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Updating instance_info_cache with network_info: [{"id": "a0c420ba-1f56-4b44-ac55-73a89368402b", "address": "fa:16:3e:32:c6:81", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c420ba-1f", "ovs_interfaceid": "a0c420ba-1f56-4b44-ac55-73a89368402b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:52:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e8a32fe0-f2c4-4a6c-b30e-4d4f7a66b228 req-7a357d4b-a12d-459a-a50b-d20f7bf54749 service nova] Releasing lock "refresh_cache-013ad5ba-e918-4c6a-8ece-33b6e11e5e40" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:52:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG os_brick.utils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bce365-0c37-4994-b701-69b793e5e674]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5761537f-99db-4f89-a547-41d93fae520e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[da50355e-1094-460a-aaf4-867654356ea5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6469c4d4-f935-46d3-a87b-8ed77f1a1c40]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:52:50 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6223775-69b4-47a0-82d4-b6a63b110ae2]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG os_brick.utils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Updating existing volume attachment record: 1a2b674a-7053-44bb-a86a-56711efe49b7 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:52:51 user nova-compute[75826]: INFO nova.compute.claims [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Claim successful on node user
Nov 16 00:52:51 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.503s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:52:51 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:52:51 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG nova.policy [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e2d1a7cea414446842b5abfc9fe93de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ad3ee3a8e04d728243e886a1460cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:52:51 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Creating image(s)
Nov 16 00:52:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "/opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "/opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "/opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.193s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.192s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Successfully created port: 63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk 1073741824" returned: 0 in 0.075s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Cannot resize image /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Ensure instance console log exists: /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Successfully updated port: 63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "refresh_cache-45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquired lock "refresh_cache-45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:52:52 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-13956dfd-466c-4041-9627-0a2f18f96f89 req-2855037e-b707-4085-9774-387610aaa38b service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Received event network-changed-63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-13956dfd-466c-4041-9627-0a2f18f96f89 req-2855037e-b707-4085-9774-387610aaa38b service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Refreshing instance network info cache due to event network-changed-63798638-71ff-4e72-864c-d73d5e82104a. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-13956dfd-466c-4041-9627-0a2f18f96f89 req-2855037e-b707-4085-9774-387610aaa38b service nova] Acquiring lock "refresh_cache-45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Updating instance_info_cache with network_info: [{"id": "63798638-71ff-4e72-864c-d73d5e82104a", "address": "fa:16:3e:5d:ba:e7", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63798638-71", "ovs_interfaceid": "63798638-71ff-4e72-864c-d73d5e82104a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Releasing lock "refresh_cache-45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Instance network_info: |[{"id": "63798638-71ff-4e72-864c-d73d5e82104a", "address": "fa:16:3e:5d:ba:e7", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63798638-71", "ovs_interfaceid": "63798638-71ff-4e72-864c-d73d5e82104a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-13956dfd-466c-4041-9627-0a2f18f96f89 req-2855037e-b707-4085-9774-387610aaa38b service nova] Acquired lock "refresh_cache-45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-13956dfd-466c-4041-9627-0a2f18f96f89 req-2855037e-b707-4085-9774-387610aaa38b service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Refreshing network info cache for port 63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Start _get_guest_xml network_info=[{"id": "63798638-71ff-4e72-864c-d73d5e82104a", "address": "fa:16:3e:5d:ba:e7", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63798638-71", "ovs_interfaceid": "63798638-71ff-4e72-864c-d73d5e82104a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:52:53 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:52:53 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:52:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-427846595',display_name='tempest-AttachVolumeNegativeTest-server-427846595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-427846595',id=35,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDy/7NJ7NPA0fJz2VwnBgvS8lTjYgfm6AeLChHJZSB0wZ6QtVAZwLpNizluQyVEp9K4WkS0MG9EpQo3lX1ToHstoVHBolcaslar+eKS5nXZ0JFOrDJPaAHBLRp47HefK0g==',key_name='tempest-keypair-894041584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ad3ee3a8e04d728243e886a1460cae',ramdisk_id='',reservation_id='r-to5xmt03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471555798',owner_user_name='tempest-AttachVolumeNegativeTest-471555798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:52:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e2d1a7cea414446842b5abfc9fe93de',uuid=45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63798638-71ff-4e72-864c-d73d5e82104a", "address": "fa:16:3e:5d:ba:e7", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63798638-71", "ovs_interfaceid": "63798638-71ff-4e72-864c-d73d5e82104a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converting VIF {"id": "63798638-71ff-4e72-864c-d73d5e82104a", "address": "fa:16:3e:5d:ba:e7", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63798638-71", "ovs_interfaceid": "63798638-71ff-4e72-864c-d73d5e82104a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ba:e7,bridge_name='br-int',has_traffic_filtering=True,id=63798638-71ff-4e72-864c-d73d5e82104a,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63798638-71') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'pci_devices' on Instance uuid 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:52:53 user nova-compute[75826]:   <uuid>45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8</uuid>
Nov 16 00:52:53 user nova-compute[75826]:   <name>instance-00000023</name>
Nov 16 00:52:53 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:52:53 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:52:53 user nova-compute[75826]:   <metadata>
Nov 16 00:52:53 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:52:53 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:52:53 user nova-compute[75826]:       <nova:name>tempest-AttachVolumeNegativeTest-server-427846595</nova:name>
Nov 16 00:52:53 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:52:53</nova:creationTime>
Nov 16 00:52:53 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:52:53 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:52:53 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:52:53 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:52:53 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:52:53 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:52:53 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:52:53 user nova-compute[75826]:       <nova:owner>
Nov 16 00:52:53 user nova-compute[75826]:         <nova:user uuid="0e2d1a7cea414446842b5abfc9fe93de">tempest-AttachVolumeNegativeTest-471555798-project-member</nova:user>
Nov 16 00:52:53 user nova-compute[75826]:         <nova:project uuid="13ad3ee3a8e04d728243e886a1460cae">tempest-AttachVolumeNegativeTest-471555798</nova:project>
Nov 16 00:52:53 user nova-compute[75826]:       </nova:owner>
Nov 16 00:52:53 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:52:53 user nova-compute[75826]:       <nova:ports>
Nov 16 00:52:53 user nova-compute[75826]:         <nova:port uuid="63798638-71ff-4e72-864c-d73d5e82104a">
Nov 16 00:52:53 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 00:52:53 user nova-compute[75826]:         </nova:port>
Nov 16 00:52:53 user nova-compute[75826]:       </nova:ports>
Nov 16 00:52:53 user nova-compute[75826]:     </nova:instance>
Nov 16 00:52:53 user nova-compute[75826]:   </metadata>
Nov 16 00:52:53 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:52:53 user nova-compute[75826]:     <system>
Nov 16 00:52:53 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:52:53 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:52:53 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:52:53 user nova-compute[75826]:       <entry name="serial">45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8</entry>
Nov 16 00:52:53 user nova-compute[75826]:       <entry name="uuid">45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8</entry>
Nov 16 00:52:53 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:52:53 user nova-compute[75826]:     </system>
Nov 16 00:52:53 user nova-compute[75826]:   </sysinfo>
Nov 16 00:52:53 user nova-compute[75826]:   <os>
Nov 16 00:52:53 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:52:53 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:52:53 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:52:53 user nova-compute[75826]:   </os>
Nov 16 00:52:53 user nova-compute[75826]:   <features>
Nov 16 00:52:53 user nova-compute[75826]:     <acpi/>
Nov 16 00:52:53 user nova-compute[75826]:     <apic/>
Nov 16 00:52:53 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:52:53 user nova-compute[75826]:   </features>
Nov 16 00:52:53 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:52:53 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:52:53 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:52:53 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:52:53 user nova-compute[75826]:   </clock>
Nov 16 00:52:53 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:52:53 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:52:53 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:52:53 user nova-compute[75826]:   </cpu>
Nov 16 00:52:53 user nova-compute[75826]:   <devices>
Nov 16 00:52:53 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:52:53 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:52:53 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk"/>
Nov 16 00:52:53 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:52:53 user nova-compute[75826]:     </disk>
Nov 16 00:52:53 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:52:53 user nova-compute[75826]:       <mac address="fa:16:3e:5d:ba:e7"/>
Nov 16 00:52:53 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:52:53 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:52:53 user nova-compute[75826]:       <target dev="tap63798638-71"/>
Nov 16 00:52:53 user nova-compute[75826]:     </interface>
Nov 16 00:52:53 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:52:53 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/console.log" append="off"/>
Nov 16 00:52:53 user nova-compute[75826]:     </serial>
Nov 16 00:52:53 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:52:53 user nova-compute[75826]:     <video>
Nov 16 00:52:53 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:52:53 user nova-compute[75826]:     </video>
Nov 16 00:52:53 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:52:53 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:52:53 user nova-compute[75826]:     </rng>
Nov 16 00:52:53 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:52:53 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:52:53 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:52:53 user nova-compute[75826]:     </memballoon>
Nov 16 00:52:53 user nova-compute[75826]:   </devices>
Nov 16 00:52:53 user nova-compute[75826]: </domain>
Nov 16 00:52:53 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:52:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-427846595',display_name='tempest-AttachVolumeNegativeTest-server-427846595',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-427846595',id=35,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDy/7NJ7NPA0fJz2VwnBgvS8lTjYgfm6AeLChHJZSB0wZ6QtVAZwLpNizluQyVEp9K4WkS0MG9EpQo3lX1ToHstoVHBolcaslar+eKS5nXZ0JFOrDJPaAHBLRp47HefK0g==',key_name='tempest-keypair-894041584',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ad3ee3a8e04d728243e886a1460cae',ramdisk_id='',reservation_id='r-to5xmt03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471555798',owner_user_name='tempest-AttachVolumeNegativeTest-471555798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:52:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e2d1a7cea414446842b5abfc9fe93de',uuid=45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "63798638-71ff-4e72-864c-d73d5e82104a", "address": "fa:16:3e:5d:ba:e7", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63798638-71", "ovs_interfaceid": "63798638-71ff-4e72-864c-d73d5e82104a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converting VIF {"id": "63798638-71ff-4e72-864c-d73d5e82104a", "address": "fa:16:3e:5d:ba:e7", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63798638-71", "ovs_interfaceid": "63798638-71ff-4e72-864c-d73d5e82104a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ba:e7,bridge_name='br-int',has_traffic_filtering=True,id=63798638-71ff-4e72-864c-d73d5e82104a,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63798638-71') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG os_vif [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ba:e7,bridge_name='br-int',has_traffic_filtering=True,id=63798638-71ff-4e72-864c-d73d5e82104a,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63798638-71') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '293284a7-a2be-5b62-a3ae-7362072d5584', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap63798638-71, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap63798638-71, col_values=(('qos', UUID('4c7f456e-bfda-4643-9167-cb02413dddb5')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap63798638-71, col_values=(('external_ids', {'iface-id': '63798638-71ff-4e72-864c-d73d5e82104a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:ba:e7', 'vm-uuid': '45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:53 user nova-compute[75826]: INFO os_vif [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:ba:e7,bridge_name='br-int',has_traffic_filtering=True,id=63798638-71ff-4e72-864c-d73d5e82104a,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63798638-71')
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No VIF found with MAC fa:16:3e:5d:ba:e7, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-13956dfd-466c-4041-9627-0a2f18f96f89 req-2855037e-b707-4085-9774-387610aaa38b service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Updated VIF entry in instance network info cache for port 63798638-71ff-4e72-864c-d73d5e82104a. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-13956dfd-466c-4041-9627-0a2f18f96f89 req-2855037e-b707-4085-9774-387610aaa38b service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Updating instance_info_cache with network_info: [{"id": "63798638-71ff-4e72-864c-d73d5e82104a", "address": "fa:16:3e:5d:ba:e7", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63798638-71", "ovs_interfaceid": "63798638-71ff-4e72-864c-d73d5e82104a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:52:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-13956dfd-466c-4041-9627-0a2f18f96f89 req-2855037e-b707-4085-9774-387610aaa38b service nova] Releasing lock "refresh_cache-45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:52:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-fd9d1ddc-6706-4622-955c-72adf26b0e0e req-1ca604f0-8bcc-44a4-9171-fa73d3389d24 service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Received event network-vif-plugged-63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fd9d1ddc-6706-4622-955c-72adf26b0e0e req-1ca604f0-8bcc-44a4-9171-fa73d3389d24 service nova] Acquiring lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fd9d1ddc-6706-4622-955c-72adf26b0e0e req-1ca604f0-8bcc-44a4-9171-fa73d3389d24 service nova] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fd9d1ddc-6706-4622-955c-72adf26b0e0e req-1ca604f0-8bcc-44a4-9171-fa73d3389d24 service nova] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-fd9d1ddc-6706-4622-955c-72adf26b0e0e req-1ca604f0-8bcc-44a4-9171-fa73d3389d24 service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] No waiting events found dispatching network-vif-plugged-63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:55 user nova-compute[75826]: WARNING nova.compute.manager [req-fd9d1ddc-6706-4622-955c-72adf26b0e0e req-1ca604f0-8bcc-44a4-9171-fa73d3389d24 service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Received unexpected event network-vif-plugged-63798638-71ff-4e72-864c-d73d5e82104a for instance with vm_state building and task_state spawning.
Nov 16 00:52:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:52:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Creating image(s)
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Ensure instance console log exists: /opt/stack/data/nova/instances/013ad5ba-e918-4c6a-8ece-33b6e11e5e40/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Start _get_guest_xml network_info=[{"id": "a0c420ba-1f56-4b44-ac55-73a89368402b", "address": "fa:16:3e:32:c6:81", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c420ba-1f", "ovs_interfaceid": "a0c420ba-1f56-4b44-ac55-73a89368402b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1a2b674a-7053-44bb-a86a-56711efe49b7', 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CvbkDGHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '013ad5ba-e918-4c6a-8ece-33b6e11e5e40', 'attached_at': '', 'detached_at': '', 'volume_id': '1c56ae35-755a-49b8-988e-8edf866194f9', 'serial': '1c56ae35-755a-49b8-988e-8edf866194f9'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:52:55 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:52:55 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CvbkDGHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:52:55 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:52:55 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:52:55 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49cda6d-57d6-4c1b-bad9-d9fa096d53c8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:52:55 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cff715-d94e-44a6-859b-8f0f42e643ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9] added
Nov 16 00:52:55 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[48aac551-2d84-4fc1-851e-1e83dd0e4125]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b88ec2-d4e8-4100-b4b9-e2027658075a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CvbkDGHz {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CvbkDGHz" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4dd6dd-26ef-450f-b71b-ccb5d4f4f6be]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CvbkDGHz'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f82b26-665d-4bad-a89f-e4490e29ad6f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3c6a01-7c4b-44ac-b44d-e59cd8846b43]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:52:55 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:52:55 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:52:55 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:52:55 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:52:55 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:52:55 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dc208e-d71d-425f-9991-2b6ab3c64d71]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9, portal: 172.16.0.220,3260]
Nov 16 00:52:55 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9, portal: 172.16.0.220,3260] successful.
Nov 16 00:52:55 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb000c9-7db2-4139-97d3-1dcf2715aa92]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:52:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1948fc-c127-4acb-a356-6fafdf145b68]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:52:56 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:52:56 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:52:56 user nova-compute[75826]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 (non-flash)
Nov 16 00:52:56 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:52:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:52:56 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:52:56 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:52:56 user nova-compute[75826]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 (non-flash)
Nov 16 00:52:56 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:52:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:52:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:52:56 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:52:56 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:52:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:52:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:52:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6d3c00-badb-48f3-ad23-0648c88d9aec]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:52:56 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-42577a44-dda4-4712-a14b-83f9efcdfc20 req-b4028cd4-4a8c-49d5-bb3b-7629665d87fa service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Received event network-vif-plugged-63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-42577a44-dda4-4712-a14b-83f9efcdfc20 req-b4028cd4-4a8c-49d5-bb3b-7629665d87fa service nova] Acquiring lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-42577a44-dda4-4712-a14b-83f9efcdfc20 req-b4028cd4-4a8c-49d5-bb3b-7629665d87fa service nova] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-42577a44-dda4-4712-a14b-83f9efcdfc20 req-b4028cd4-4a8c-49d5-bb3b-7629665d87fa service nova] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-42577a44-dda4-4712-a14b-83f9efcdfc20 req-b4028cd4-4a8c-49d5-bb3b-7629665d87fa service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] No waiting events found dispatching network-vif-plugged-63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:57 user nova-compute[75826]: WARNING nova.compute.manager [req-42577a44-dda4-4712-a14b-83f9efcdfc20 req-b4028cd4-4a8c-49d5-bb3b-7629665d87fa service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Received unexpected event network-vif-plugged-63798638-71ff-4e72-864c-d73d5e82104a for instance with vm_state building and task_state spawning.
Nov 16 00:52:57 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CvbkDGHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26236396134343338', 'path': '/dev/sdd'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236396134343338', 'path': '/dev/sdd'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1327463880',display_name='tempest-TestVolumeBootPattern-server-1327463880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1327463880',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-4dllluok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:52:44Z,user_data=None,user_id='6c17265442bc48f9b6de5367e91096b2',uuid=013ad5ba-e918-4c6a-8ece-33b6e11e5e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0c420ba-1f56-4b44-ac55-73a89368402b", "address": "fa:16:3e:32:c6:81", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c420ba-1f", "ovs_interfaceid": "a0c420ba-1f56-4b44-ac55-73a89368402b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "a0c420ba-1f56-4b44-ac55-73a89368402b", "address": "fa:16:3e:32:c6:81", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c420ba-1f", "ovs_interfaceid": "a0c420ba-1f56-4b44-ac55-73a89368402b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=a0c420ba-1f56-4b44-ac55-73a89368402b,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c420ba-1f') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.objects.instance [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lazy-loading 'pci_devices' on Instance uuid 013ad5ba-e918-4c6a-8ece-33b6e11e5e40 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:52:57 user nova-compute[75826]:   <uuid>013ad5ba-e918-4c6a-8ece-33b6e11e5e40</uuid>
Nov 16 00:52:57 user nova-compute[75826]:   <name>instance-00000022</name>
Nov 16 00:52:57 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:52:57 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:52:57 user nova-compute[75826]:   <metadata>
Nov 16 00:52:57 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:52:57 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:52:57 user nova-compute[75826]:       <nova:name>tempest-TestVolumeBootPattern-server-1327463880</nova:name>
Nov 16 00:52:57 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:52:55</nova:creationTime>
Nov 16 00:52:57 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:52:57 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:52:57 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:52:57 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:52:57 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:52:57 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:52:57 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:52:57 user nova-compute[75826]:       <nova:owner>
Nov 16 00:52:57 user nova-compute[75826]:         <nova:user uuid="6c17265442bc48f9b6de5367e91096b2">tempest-TestVolumeBootPattern-2108626012-project-member</nova:user>
Nov 16 00:52:57 user nova-compute[75826]:         <nova:project uuid="ef4135693756414fb70826b0f1d9345c">tempest-TestVolumeBootPattern-2108626012</nova:project>
Nov 16 00:52:57 user nova-compute[75826]:       </nova:owner>
Nov 16 00:52:57 user nova-compute[75826]:       <nova:ports>
Nov 16 00:52:57 user nova-compute[75826]:         <nova:port uuid="a0c420ba-1f56-4b44-ac55-73a89368402b">
Nov 16 00:52:57 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 00:52:57 user nova-compute[75826]:         </nova:port>
Nov 16 00:52:57 user nova-compute[75826]:       </nova:ports>
Nov 16 00:52:57 user nova-compute[75826]:     </nova:instance>
Nov 16 00:52:57 user nova-compute[75826]:   </metadata>
Nov 16 00:52:57 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:52:57 user nova-compute[75826]:     <system>
Nov 16 00:52:57 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:52:57 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:52:57 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:52:57 user nova-compute[75826]:       <entry name="serial">013ad5ba-e918-4c6a-8ece-33b6e11e5e40</entry>
Nov 16 00:52:57 user nova-compute[75826]:       <entry name="uuid">013ad5ba-e918-4c6a-8ece-33b6e11e5e40</entry>
Nov 16 00:52:57 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:52:57 user nova-compute[75826]:     </system>
Nov 16 00:52:57 user nova-compute[75826]:   </sysinfo>
Nov 16 00:52:57 user nova-compute[75826]:   <os>
Nov 16 00:52:57 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:52:57 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:52:57 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:52:57 user nova-compute[75826]:   </os>
Nov 16 00:52:57 user nova-compute[75826]:   <features>
Nov 16 00:52:57 user nova-compute[75826]:     <acpi/>
Nov 16 00:52:57 user nova-compute[75826]:     <apic/>
Nov 16 00:52:57 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:52:57 user nova-compute[75826]:   </features>
Nov 16 00:52:57 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:52:57 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:52:57 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:52:57 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:52:57 user nova-compute[75826]:   </clock>
Nov 16 00:52:57 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:52:57 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:52:57 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:52:57 user nova-compute[75826]:   </cpu>
Nov 16 00:52:57 user nova-compute[75826]:   <devices>
Nov 16 00:52:57 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:52:57 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:52:57 user nova-compute[75826]:       <source dev="/dev/sdd"/>
Nov 16 00:52:57 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:52:57 user nova-compute[75826]:       <serial>1c56ae35-755a-49b8-988e-8edf866194f9</serial>
Nov 16 00:52:57 user nova-compute[75826]:     </disk>
Nov 16 00:52:57 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:52:57 user nova-compute[75826]:       <mac address="fa:16:3e:32:c6:81"/>
Nov 16 00:52:57 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:52:57 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:52:57 user nova-compute[75826]:       <target dev="tapa0c420ba-1f"/>
Nov 16 00:52:57 user nova-compute[75826]:     </interface>
Nov 16 00:52:57 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:52:57 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/013ad5ba-e918-4c6a-8ece-33b6e11e5e40/console.log" append="off"/>
Nov 16 00:52:57 user nova-compute[75826]:     </serial>
Nov 16 00:52:57 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:52:57 user nova-compute[75826]:     <video>
Nov 16 00:52:57 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:52:57 user nova-compute[75826]:     </video>
Nov 16 00:52:57 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:52:57 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:52:57 user nova-compute[75826]:     </rng>
Nov 16 00:52:57 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:52:57 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:52:57 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:52:57 user nova-compute[75826]:     </memballoon>
Nov 16 00:52:57 user nova-compute[75826]:   </devices>
Nov 16 00:52:57 user nova-compute[75826]: </domain>
Nov 16 00:52:57 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1327463880',display_name='tempest-TestVolumeBootPattern-server-1327463880',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1327463880',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-4dllluok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:52:44Z,user_data=None,user_id='6c17265442bc48f9b6de5367e91096b2',uuid=013ad5ba-e918-4c6a-8ece-33b6e11e5e40,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0c420ba-1f56-4b44-ac55-73a89368402b", "address": "fa:16:3e:32:c6:81", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c420ba-1f", "ovs_interfaceid": "a0c420ba-1f56-4b44-ac55-73a89368402b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "a0c420ba-1f56-4b44-ac55-73a89368402b", "address": "fa:16:3e:32:c6:81", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c420ba-1f", "ovs_interfaceid": "a0c420ba-1f56-4b44-ac55-73a89368402b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=a0c420ba-1f56-4b44-ac55-73a89368402b,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c420ba-1f') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG os_vif [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=a0c420ba-1f56-4b44-ac55-73a89368402b,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c420ba-1f') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddfd5eb4-c5d1-569c-93ef-d3f44f1ce3d1', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0c420ba-1f, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0c420ba-1f, col_values=(('qos', UUID('70d572ff-2e9d-41de-90f5-b63ca312b04b')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0c420ba-1f, col_values=(('external_ids', {'iface-id': 'a0c420ba-1f56-4b44-ac55-73a89368402b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:32:c6:81', 'vm-uuid': '013ad5ba-e918-4c6a-8ece-33b6e11e5e40'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:57 user nova-compute[75826]: INFO os_vif [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=a0c420ba-1f56-4b44-ac55-73a89368402b,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c420ba-1f')
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] No VIF found with MAC fa:16:3e:32:c6:81, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:52:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Instance spawned successfully.
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:52:57 user nova-compute[75826]: INFO nova.compute.manager [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 16 00:52:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:52:57 user nova-compute[75826]: INFO nova.compute.manager [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Took 6.36 seconds to build instance.
Nov 16 00:52:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c63ed333-eecb-4709-a316-d01006970cde tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.460s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-d153dc90-d049-4ffd-99c2-8ec693d6abb9 req-315a0656-7867-4cd4-be68-5363105e7234 service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Received event network-vif-plugged-a0c420ba-1f56-4b44-ac55-73a89368402b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:52:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d153dc90-d049-4ffd-99c2-8ec693d6abb9 req-315a0656-7867-4cd4-be68-5363105e7234 service nova] Acquiring lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:52:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d153dc90-d049-4ffd-99c2-8ec693d6abb9 req-315a0656-7867-4cd4-be68-5363105e7234 service nova] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:52:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d153dc90-d049-4ffd-99c2-8ec693d6abb9 req-315a0656-7867-4cd4-be68-5363105e7234 service nova] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:52:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-d153dc90-d049-4ffd-99c2-8ec693d6abb9 req-315a0656-7867-4cd4-be68-5363105e7234 service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] No waiting events found dispatching network-vif-plugged-a0c420ba-1f56-4b44-ac55-73a89368402b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:52:58 user nova-compute[75826]: WARNING nova.compute.manager [req-d153dc90-d049-4ffd-99c2-8ec693d6abb9 req-315a0656-7867-4cd4-be68-5363105e7234 service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Received unexpected event network-vif-plugged-a0c420ba-1f56-4b44-ac55-73a89368402b for instance with vm_state building and task_state spawning.
Nov 16 00:52:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:52:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:53:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:53:00 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Instance spawned successfully.
Nov 16 00:53:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:53:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-06387304-536b-4d9c-b3f9-a317aecbbbaa req-0c62a262-b987-4fd7-bafb-92648016d21b service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Received event network-vif-plugged-a0c420ba-1f56-4b44-ac55-73a89368402b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:53:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-06387304-536b-4d9c-b3f9-a317aecbbbaa req-0c62a262-b987-4fd7-bafb-92648016d21b service nova] Acquiring lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-06387304-536b-4d9c-b3f9-a317aecbbbaa req-0c62a262-b987-4fd7-bafb-92648016d21b service nova] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-06387304-536b-4d9c-b3f9-a317aecbbbaa req-0c62a262-b987-4fd7-bafb-92648016d21b service nova] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-06387304-536b-4d9c-b3f9-a317aecbbbaa req-0c62a262-b987-4fd7-bafb-92648016d21b service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] No waiting events found dispatching network-vif-plugged-a0c420ba-1f56-4b44-ac55-73a89368402b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:53:00 user nova-compute[75826]: WARNING nova.compute.manager [req-06387304-536b-4d9c-b3f9-a317aecbbbaa req-0c62a262-b987-4fd7-bafb-92648016d21b service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Received unexpected event network-vif-plugged-a0c420ba-1f56-4b44-ac55-73a89368402b for instance with vm_state building and task_state spawning.
Nov 16 00:53:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:53:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:53:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:53:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:53:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:53:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:53:00 user nova-compute[75826]: INFO nova.compute.manager [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 16 00:53:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:53:00 user nova-compute[75826]: INFO nova.compute.manager [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Took 17.65 seconds to build instance.
Nov 16 00:53:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a3e9f17e-3728-4c8c-b028-7303890422d0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.753s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:03 user nova-compute[75826]: INFO nova.compute.manager [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Terminating instance
Nov 16 00:53:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-a6f7821b-e12a-488b-b098-e19a7df670ac req-aa54f8f4-780d-4d98-bc2b-654a4f4467cd service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-unplugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a6f7821b-e12a-488b-b098-e19a7df670ac req-aa54f8f4-780d-4d98-bc2b-654a4f4467cd service nova] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a6f7821b-e12a-488b-b098-e19a7df670ac req-aa54f8f4-780d-4d98-bc2b-654a4f4467cd service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a6f7821b-e12a-488b-b098-e19a7df670ac req-aa54f8f4-780d-4d98-bc2b-654a4f4467cd service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-a6f7821b-e12a-488b-b098-e19a7df670ac req-aa54f8f4-780d-4d98-bc2b-654a4f4467cd service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] No waiting events found dispatching network-vif-unplugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-a6f7821b-e12a-488b-b098-e19a7df670ac req-aa54f8f4-780d-4d98-bc2b-654a4f4467cd service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-unplugged-ff64782d-047b-4488-80c5-b8866a0c5037 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:53:03 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Instance destroyed successfully.
Nov 16 00:53:03 user nova-compute[75826]: DEBUG nova.objects.instance [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'resources' on Instance uuid 298c8986-b91b-4f46-bcce-75e28bc02b5f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:43:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1610404613',display_name='tempest-AttachVolumeTestJSON-server-1610404613',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1610404613',id=17,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPd46vcTYm1IGljsZJY5d+bnsYtZu5mDPgxXnccpiKGtfwu7f4jNN4sCNE2xSEkbiGF7AI/QCdZlu654F87C0DsVVQp1j+jeloZ54u8nfEkpLHA8I7BQPi8srBhE2Ey6w==',key_name='tempest-keypair-1910536779',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:43:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa522b01f20c4d90bc4178e688319e7f',ramdisk_id='',reservation_id='r-tf175bq6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1305137356',owner_user_name='tempest-AttachVolumeTestJSON-1305137356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:51:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96797fc178ed4c2190f7a760b3bd30bd',uuid=298c8986-b91b-4f46-bcce-75e28bc02b5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converting VIF {"id": "ff64782d-047b-4488-80c5-b8866a0c5037", "address": "fa:16:3e:fc:58:e0", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff64782d-04", "ovs_interfaceid": "ff64782d-047b-4488-80c5-b8866a0c5037", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG os_vif [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff64782d-04, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3e8ea70e-35a8-4c5e-8fef-0f34b75726fc) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:53:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:53:04 user nova-compute[75826]: INFO os_vif [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:58:e0,bridge_name='br-int',has_traffic_filtering=True,id=ff64782d-047b-4488-80c5-b8866a0c5037,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff64782d-04')
Nov 16 00:53:04 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Deleting instance files /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f_del
Nov 16 00:53:04 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Deletion of /opt/stack/data/nova/instances/298c8986-b91b-4f46-bcce-75e28bc02b5f_del complete
Nov 16 00:53:04 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:53:04 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:53:04 user nova-compute[75826]: INFO nova.compute.manager [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 00:53:04 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:53:04 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:53:04 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:53:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:04 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:53:04 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Took 0.74 seconds to deallocate network for instance.
Nov 16 00:53:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-90b89fe3-d284-41b3-960c-09d07ad78128 req-a150e128-3ead-4242-8017-c4bf8ffba8a9 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-deleted-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:53:04 user nova-compute[75826]: INFO nova.compute.manager [req-90b89fe3-d284-41b3-960c-09d07ad78128 req-a150e128-3ead-4242-8017-c4bf8ffba8a9 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Neutron deleted interface ff64782d-047b-4488-80c5-b8866a0c5037; detaching it from the instance and deleting it from the info cache
Nov 16 00:53:04 user nova-compute[75826]: DEBUG nova.network.neutron [req-90b89fe3-d284-41b3-960c-09d07ad78128 req-a150e128-3ead-4242-8017-c4bf8ffba8a9 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:53:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-90b89fe3-d284-41b3-960c-09d07ad78128 req-a150e128-3ead-4242-8017-c4bf8ffba8a9 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Detach interface failed, port_id=ff64782d-047b-4488-80c5-b8866a0c5037, reason: Instance 298c8986-b91b-4f46-bcce-75e28bc02b5f could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:53:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:05 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:53:05 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:53:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:05 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Deleted allocations for instance 298c8986-b91b-4f46-bcce-75e28bc02b5f
Nov 16 00:53:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7b915ef0-40fa-4ecc-876d-e92018afe43e tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.292s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-2b9f48c6-fb7c-4f6b-9431-fcd6df2d170b req-6f0f5412-ce5e-4298-a2c2-7fa3362889d5 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:53:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2b9f48c6-fb7c-4f6b-9431-fcd6df2d170b req-6f0f5412-ce5e-4298-a2c2-7fa3362889d5 service nova] Acquiring lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2b9f48c6-fb7c-4f6b-9431-fcd6df2d170b req-6f0f5412-ce5e-4298-a2c2-7fa3362889d5 service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2b9f48c6-fb7c-4f6b-9431-fcd6df2d170b req-6f0f5412-ce5e-4298-a2c2-7fa3362889d5 service nova] Lock "298c8986-b91b-4f46-bcce-75e28bc02b5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-2b9f48c6-fb7c-4f6b-9431-fcd6df2d170b req-6f0f5412-ce5e-4298-a2c2-7fa3362889d5 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] No waiting events found dispatching network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:53:05 user nova-compute[75826]: WARNING nova.compute.manager [req-2b9f48c6-fb7c-4f6b-9431-fcd6df2d170b req-6f0f5412-ce5e-4298-a2c2-7fa3362889d5 service nova] [instance: 298c8986-b91b-4f46-bcce-75e28bc02b5f] Received unexpected event network-vif-plugged-ff64782d-047b-4488-80c5-b8866a0c5037 for instance with vm_state deleted and task_state None.
Nov 16 00:53:06 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Updating instance_info_cache with network_info: [{"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:53:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:53:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:10 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:53:10 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:53:10 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7677MB free_disk=25.159839630126953GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:53:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Applying migration context for instance 38a96872-51b5-448d-83c8-f722520d128c as it has an incoming, in-progress migration 58becfc1-af9d-40f4-89cf-7ba3023c6e7d. Migration status is finished {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 00:53:11 user nova-compute[75826]: INFO nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Updating resource usage from migration 58becfc1-af9d-40f4-89cf-7ba3023c6e7d
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 87b2703e-0154-445e-b659-5f5cf1d9f8f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance cc77d9aa-4052-40dd-9495-3a516d8f0793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 34bed458-5248-473d-b022-7f953669d85c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Migration 58becfc1-af9d-40f4-89cf-7ba3023c6e7d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 38a96872-51b5-448d-83c8-f722520d128c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 013ad5ba-e918-4c6a-8ece-33b6e11e5e40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:53:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.533s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:13 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:53:13 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:53:13 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:53:13 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:53:13 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:53:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:53:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:15 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:53:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:23 user nova-compute[75826]: INFO nova.compute.manager [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Unshelving
Nov 16 00:53:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:24 user nova-compute[75826]: DEBUG nova.objects.instance [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'pci_requests' on Instance uuid cb8a1a92-10de-4bdc-b730-83bae29ff92b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:53:24 user nova-compute[75826]: DEBUG nova.objects.instance [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'numa_topology' on Instance uuid cb8a1a92-10de-4bdc-b730-83bae29ff92b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:53:24 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:53:24 user nova-compute[75826]: INFO nova.compute.claims [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Claim successful on node user
Nov 16 00:53:24 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:53:24 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:53:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.460s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:24 user nova-compute[75826]: INFO nova.network.neutron [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Updating port 5c4ad1d8-e2df-47a7-9305-538ad370dfba with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 00:53:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquired lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG nova.network.neutron [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-26635e5f-d5ed-44e3-b341-9867dcfa7dc1 req-5ec4f543-93cb-49f0-b018-a244ddb80c6b service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-changed-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-26635e5f-d5ed-44e3-b341-9867dcfa7dc1 req-5ec4f543-93cb-49f0-b018-a244ddb80c6b service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Refreshing instance network info cache due to event network-changed-5c4ad1d8-e2df-47a7-9305-538ad370dfba. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-26635e5f-d5ed-44e3-b341-9867dcfa7dc1 req-5ec4f543-93cb-49f0-b018-a244ddb80c6b service nova] Acquiring lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG nova.network.neutron [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Updating instance_info_cache with network_info: [{"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Releasing lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:53:25 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Creating image(s)
Nov 16 00:53:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "/opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "/opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "/opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG nova.objects.instance [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'trusted_certs' on Instance uuid cb8a1a92-10de-4bdc-b730-83bae29ff92b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-26635e5f-d5ed-44e3-b341-9867dcfa7dc1 req-5ec4f543-93cb-49f0-b018-a244ddb80c6b service nova] Acquired lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG nova.network.neutron [req-26635e5f-d5ed-44e3-b341-9867dcfa7dc1 req-5ec4f543-93cb-49f0-b018-a244ddb80c6b service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Refreshing network info cache for port 5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG nova.objects.base [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Object Instance<cb8a1a92-10de-4bdc-b730-83bae29ff92b> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a.part --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a.part --force-share --output=json" returned: 0 in 0.172s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:26 user nova-compute[75826]: DEBUG nova.virt.images [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] 53eb5b79-49e2-4115-943a-4736eec6327b was qcow2, converting to raw {{(pid=75826) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 00:53:26 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:53:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a.part /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a.converted {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a.part /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a.converted" returned: 0 in 0.224s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a.converted --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.675s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG nova.network.neutron [req-26635e5f-d5ed-44e3-b341-9867dcfa7dc1 req-5ec4f543-93cb-49f0-b018-a244ddb80c6b service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Updated VIF entry in instance network info cache for port 5c4ad1d8-e2df-47a7-9305-538ad370dfba. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG nova.network.neutron [req-26635e5f-d5ed-44e3-b341-9867dcfa7dc1 req-5ec4f543-93cb-49f0-b018-a244ddb80c6b service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Updating instance_info_cache with network_info: [{"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-26635e5f-d5ed-44e3-b341-9867dcfa7dc1 req-5ec4f543-93cb-49f0-b018-a244ddb80c6b service nova] Releasing lock "refresh_cache-cb8a1a92-10de-4bdc-b730-83bae29ff92b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a,backing_fmt=raw /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a,backing_fmt=raw /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk 1073741824" returned: 0 in 0.046s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG nova.objects.instance [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'migration_context' on Instance uuid cb8a1a92-10de-4bdc-b730-83bae29ff92b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:53:27 user nova-compute[75826]: DEBUG nova.objects.base [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Object Instance<cb8a1a92-10de-4bdc-b730-83bae29ff92b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:53:27 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Rebasing disk image.
Nov 16 00:53:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e -F raw /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e -F raw /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk" returned: 0 in 2.477s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Ensure instance console log exists: /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Start _get_guest_xml network_info=[{"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='251cd4bc902a9abfaf8b8d2c8ec5df39',container_format='bare',created_at=2023-11-16T00:51:31Z,direct_url=<?>,disk_format='qcow2',id=53eb5b79-49e2-4115-943a-4736eec6327b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1266665264-shelved',owner='c770637392a544c48a72c953bfd9e7c6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T00:51:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:53:30 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:53:30 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='251cd4bc902a9abfaf8b8d2c8ec5df39',container_format='bare',created_at=2023-11-16T00:51:31Z,direct_url=<?>,disk_format='qcow2',id=53eb5b79-49e2-4115-943a-4736eec6327b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1266665264-shelved',owner='c770637392a544c48a72c953bfd9e7c6',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-16T00:51:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.objects.instance [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'vcpu_model' on Instance uuid cb8a1a92-10de-4bdc-b730-83bae29ff92b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.objects.base [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Object Instance<cb8a1a92-10de-4bdc-b730-83bae29ff92b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T00:49:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1266665264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1266665264',id=30,image_ref='53eb5b79-49e2-4115-943a-4736eec6327b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1217439759',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c770637392a544c48a72c953bfd9e7c6',ramdisk_id='',reservation_id='r-ip881mu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849437325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849437325-project-member',shelved_at='2023-11-16T00:51:35.822001',shelved_host='user',shelved_image_id='53eb5b79-49e2-4115-943a-4736eec6327b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a858d73834524c86a1c5c8514270761e',uuid=cb8a1a92-10de-4bdc-b730-83bae29ff92b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converting VIF {"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.objects.instance [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'pci_devices' on Instance uuid cb8a1a92-10de-4bdc-b730-83bae29ff92b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.objects.base [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Object Instance<cb8a1a92-10de-4bdc-b730-83bae29ff92b> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:53:30 user nova-compute[75826]:   <uuid>cb8a1a92-10de-4bdc-b730-83bae29ff92b</uuid>
Nov 16 00:53:30 user nova-compute[75826]:   <name>instance-0000001e</name>
Nov 16 00:53:30 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:53:30 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:53:30 user nova-compute[75826]:   <metadata>
Nov 16 00:53:30 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:53:30 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:53:30 user nova-compute[75826]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1266665264</nova:name>
Nov 16 00:53:30 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:53:30</nova:creationTime>
Nov 16 00:53:30 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:53:30 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:53:30 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:53:30 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:53:30 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:53:30 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:53:30 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:53:30 user nova-compute[75826]:       <nova:owner>
Nov 16 00:53:30 user nova-compute[75826]:         <nova:user uuid="a858d73834524c86a1c5c8514270761e">tempest-AttachVolumeShelveTestJSON-1849437325-project-member</nova:user>
Nov 16 00:53:30 user nova-compute[75826]:         <nova:project uuid="c770637392a544c48a72c953bfd9e7c6">tempest-AttachVolumeShelveTestJSON-1849437325</nova:project>
Nov 16 00:53:30 user nova-compute[75826]:       </nova:owner>
Nov 16 00:53:30 user nova-compute[75826]:       <nova:root type="image" uuid="53eb5b79-49e2-4115-943a-4736eec6327b"/>
Nov 16 00:53:30 user nova-compute[75826]:       <nova:ports>
Nov 16 00:53:30 user nova-compute[75826]:         <nova:port uuid="5c4ad1d8-e2df-47a7-9305-538ad370dfba">
Nov 16 00:53:30 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 16 00:53:30 user nova-compute[75826]:         </nova:port>
Nov 16 00:53:30 user nova-compute[75826]:       </nova:ports>
Nov 16 00:53:30 user nova-compute[75826]:     </nova:instance>
Nov 16 00:53:30 user nova-compute[75826]:   </metadata>
Nov 16 00:53:30 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:53:30 user nova-compute[75826]:     <system>
Nov 16 00:53:30 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:53:30 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:53:30 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:53:30 user nova-compute[75826]:       <entry name="serial">cb8a1a92-10de-4bdc-b730-83bae29ff92b</entry>
Nov 16 00:53:30 user nova-compute[75826]:       <entry name="uuid">cb8a1a92-10de-4bdc-b730-83bae29ff92b</entry>
Nov 16 00:53:30 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:53:30 user nova-compute[75826]:     </system>
Nov 16 00:53:30 user nova-compute[75826]:   </sysinfo>
Nov 16 00:53:30 user nova-compute[75826]:   <os>
Nov 16 00:53:30 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:53:30 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:53:30 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:53:30 user nova-compute[75826]:   </os>
Nov 16 00:53:30 user nova-compute[75826]:   <features>
Nov 16 00:53:30 user nova-compute[75826]:     <acpi/>
Nov 16 00:53:30 user nova-compute[75826]:     <apic/>
Nov 16 00:53:30 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:53:30 user nova-compute[75826]:   </features>
Nov 16 00:53:30 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:53:30 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:53:30 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:53:30 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:53:30 user nova-compute[75826]:   </clock>
Nov 16 00:53:30 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:53:30 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:53:30 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:53:30 user nova-compute[75826]:   </cpu>
Nov 16 00:53:30 user nova-compute[75826]:   <devices>
Nov 16 00:53:30 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:53:30 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:53:30 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk"/>
Nov 16 00:53:30 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:53:30 user nova-compute[75826]:     </disk>
Nov 16 00:53:30 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:53:30 user nova-compute[75826]:       <mac address="fa:16:3e:cc:63:f5"/>
Nov 16 00:53:30 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:53:30 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:53:30 user nova-compute[75826]:       <target dev="tap5c4ad1d8-e2"/>
Nov 16 00:53:30 user nova-compute[75826]:     </interface>
Nov 16 00:53:30 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:53:30 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/console.log" append="off"/>
Nov 16 00:53:30 user nova-compute[75826]:     </serial>
Nov 16 00:53:30 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:53:30 user nova-compute[75826]:     <video>
Nov 16 00:53:30 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:53:30 user nova-compute[75826]:     </video>
Nov 16 00:53:30 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:53:30 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:53:30 user nova-compute[75826]:     </rng>
Nov 16 00:53:30 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:53:30 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:53:30 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:53:30 user nova-compute[75826]:     </memballoon>
Nov 16 00:53:30 user nova-compute[75826]:   </devices>
Nov 16 00:53:30 user nova-compute[75826]: </domain>
Nov 16 00:53:30 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T00:49:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1266665264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1266665264',id=30,image_ref='53eb5b79-49e2-4115-943a-4736eec6327b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1217439759',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:49:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='c770637392a544c48a72c953bfd9e7c6',ramdisk_id='',reservation_id='r-ip881mu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849437325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849437325-project-member',shelved_at='2023-11-16T00:51:35.822001',shelved_host='user',shelved_image_id='53eb5b79-49e2-4115-943a-4736eec6327b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:53:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a858d73834524c86a1c5c8514270761e',uuid=cb8a1a92-10de-4bdc-b730-83bae29ff92b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converting VIF {"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG os_vif [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b9e445b-71c7-5490-8e67-1595f3ccb532', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c4ad1d8-e2, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c4ad1d8-e2, col_values=(('qos', UUID('ecceae31-a014-46b1-ae98-91d7bf0fd111')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c4ad1d8-e2, col_values=(('external_ids', {'iface-id': '5c4ad1d8-e2df-47a7-9305-538ad370dfba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:63:f5', 'vm-uuid': 'cb8a1a92-10de-4bdc-b730-83bae29ff92b'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:30 user nova-compute[75826]: INFO os_vif [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2')
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:53:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] No VIF found with MAC fa:16:3e:cc:63:f5, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:53:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:32 user nova-compute[75826]: DEBUG nova.compute.manager [req-59708fc3-a8cc-4709-a5cf-15c045cc844c req-d5a77710-b0de-4130-b3a4-5451d734c693 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:53:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-59708fc3-a8cc-4709-a5cf-15c045cc844c req-d5a77710-b0de-4130-b3a4-5451d734c693 service nova] Acquiring lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-59708fc3-a8cc-4709-a5cf-15c045cc844c req-d5a77710-b0de-4130-b3a4-5451d734c693 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-59708fc3-a8cc-4709-a5cf-15c045cc844c req-d5a77710-b0de-4130-b3a4-5451d734c693 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:32 user nova-compute[75826]: DEBUG nova.compute.manager [req-59708fc3-a8cc-4709-a5cf-15c045cc844c req-d5a77710-b0de-4130-b3a4-5451d734c693 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] No waiting events found dispatching network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:53:32 user nova-compute[75826]: WARNING nova.compute.manager [req-59708fc3-a8cc-4709-a5cf-15c045cc844c req-d5a77710-b0de-4130-b3a4-5451d734c693 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received unexpected event network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 00:53:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:53:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:53:34 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Instance spawned successfully.
Nov 16 00:53:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-f7a0d22d-a857-4110-b663-ef82484700c1 req-b4a10e18-33e9-435d-a855-d99616fc7a12 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:53:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f7a0d22d-a857-4110-b663-ef82484700c1 req-b4a10e18-33e9-435d-a855-d99616fc7a12 service nova] Acquiring lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f7a0d22d-a857-4110-b663-ef82484700c1 req-b4a10e18-33e9-435d-a855-d99616fc7a12 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f7a0d22d-a857-4110-b663-ef82484700c1 req-b4a10e18-33e9-435d-a855-d99616fc7a12 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-f7a0d22d-a857-4110-b663-ef82484700c1 req-b4a10e18-33e9-435d-a855-d99616fc7a12 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] No waiting events found dispatching network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:53:34 user nova-compute[75826]: WARNING nova.compute.manager [req-f7a0d22d-a857-4110-b663-ef82484700c1 req-b4a10e18-33e9-435d-a855-d99616fc7a12 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received unexpected event network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 00:53:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:53:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00a2ec2e-db63-45bb-bcda-87ae4d857286 tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.652s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:53:57 user nova-compute[75826]: INFO nova.compute.claims [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Claim successful on node user
Nov 16 00:53:57 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:53:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:53:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG nova.policy [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96797fc178ed4c2190f7a760b3bd30bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aa522b01f20c4d90bc4178e688319e7f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:53:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Creating image(s)
Nov 16 00:53:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "/opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "/opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:57 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.189s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk 1073741824" returned: 0 in 0.049s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Successfully created port: 835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.196s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Cannot resize image /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Ensure instance console log exists: /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:53:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Successfully updated port: 835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "refresh_cache-bdd698af-6740-4dc2-8411-54ccb62a48a9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquired lock "refresh_cache-bdd698af-6740-4dc2-8411-54ccb62a48a9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-a154f499-f435-492e-8f99-9de59093d523 req-7a5e0401-60c1-4f2a-921b-df8ad6ac532c service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Received event network-changed-835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-a154f499-f435-492e-8f99-9de59093d523 req-7a5e0401-60c1-4f2a-921b-df8ad6ac532c service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Refreshing instance network info cache due to event network-changed-835bfef6-ab32-4a31-b7e2-3c189e15d489. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a154f499-f435-492e-8f99-9de59093d523 req-7a5e0401-60c1-4f2a-921b-df8ad6ac532c service nova] Acquiring lock "refresh_cache-bdd698af-6740-4dc2-8411-54ccb62a48a9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Updating instance_info_cache with network_info: [{"id": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "address": "fa:16:3e:ee:89:64", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835bfef6-ab", "ovs_interfaceid": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Releasing lock "refresh_cache-bdd698af-6740-4dc2-8411-54ccb62a48a9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Instance network_info: |[{"id": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "address": "fa:16:3e:ee:89:64", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835bfef6-ab", "ovs_interfaceid": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a154f499-f435-492e-8f99-9de59093d523 req-7a5e0401-60c1-4f2a-921b-df8ad6ac532c service nova] Acquired lock "refresh_cache-bdd698af-6740-4dc2-8411-54ccb62a48a9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.network.neutron [req-a154f499-f435-492e-8f99-9de59093d523 req-7a5e0401-60c1-4f2a-921b-df8ad6ac532c service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Refreshing network info cache for port 835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Start _get_guest_xml network_info=[{"id": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "address": "fa:16:3e:ee:89:64", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835bfef6-ab", "ovs_interfaceid": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:53:59 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:53:59 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1713999345',display_name='tempest-AttachVolumeTestJSON-server-1713999345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1713999345',id=36,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeoBt67AqiEq2qRF8NLARpnjmNcoRaAiYJKRAng0U0fbJ07DiPlER8YIajLTs/sqe+gVcL9xY+4qaDzdHXH+RrZ7Y0BN20FLhE5xqPj67NfW/5RqW/gZfl7QHMb8sVU0w==',key_name='tempest-keypair-1598111726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa522b01f20c4d90bc4178e688319e7f',ramdisk_id='',reservation_id='r-hvio6q2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1305137356',owner_user_name='tempest-AttachVolumeTestJSON-1305137356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96797fc178ed4c2190f7a760b3bd30bd',uuid=bdd698af-6740-4dc2-8411-54ccb62a48a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "address": "fa:16:3e:ee:89:64", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835bfef6-ab", "ovs_interfaceid": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converting VIF {"id": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "address": "fa:16:3e:ee:89:64", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835bfef6-ab", "ovs_interfaceid": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:89:64,bridge_name='br-int',has_traffic_filtering=True,id=835bfef6-ab32-4a31-b7e2-3c189e15d489,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835bfef6-ab') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.objects.instance [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'pci_devices' on Instance uuid bdd698af-6740-4dc2-8411-54ccb62a48a9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:53:59 user nova-compute[75826]:   <uuid>bdd698af-6740-4dc2-8411-54ccb62a48a9</uuid>
Nov 16 00:53:59 user nova-compute[75826]:   <name>instance-00000024</name>
Nov 16 00:53:59 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:53:59 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:53:59 user nova-compute[75826]:   <metadata>
Nov 16 00:53:59 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:53:59 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:53:59 user nova-compute[75826]:       <nova:name>tempest-AttachVolumeTestJSON-server-1713999345</nova:name>
Nov 16 00:53:59 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:53:59</nova:creationTime>
Nov 16 00:53:59 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:53:59 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:53:59 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:53:59 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:53:59 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:53:59 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:53:59 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:53:59 user nova-compute[75826]:       <nova:owner>
Nov 16 00:53:59 user nova-compute[75826]:         <nova:user uuid="96797fc178ed4c2190f7a760b3bd30bd">tempest-AttachVolumeTestJSON-1305137356-project-member</nova:user>
Nov 16 00:53:59 user nova-compute[75826]:         <nova:project uuid="aa522b01f20c4d90bc4178e688319e7f">tempest-AttachVolumeTestJSON-1305137356</nova:project>
Nov 16 00:53:59 user nova-compute[75826]:       </nova:owner>
Nov 16 00:53:59 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:53:59 user nova-compute[75826]:       <nova:ports>
Nov 16 00:53:59 user nova-compute[75826]:         <nova:port uuid="835bfef6-ab32-4a31-b7e2-3c189e15d489">
Nov 16 00:53:59 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 16 00:53:59 user nova-compute[75826]:         </nova:port>
Nov 16 00:53:59 user nova-compute[75826]:       </nova:ports>
Nov 16 00:53:59 user nova-compute[75826]:     </nova:instance>
Nov 16 00:53:59 user nova-compute[75826]:   </metadata>
Nov 16 00:53:59 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:53:59 user nova-compute[75826]:     <system>
Nov 16 00:53:59 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:53:59 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:53:59 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:53:59 user nova-compute[75826]:       <entry name="serial">bdd698af-6740-4dc2-8411-54ccb62a48a9</entry>
Nov 16 00:53:59 user nova-compute[75826]:       <entry name="uuid">bdd698af-6740-4dc2-8411-54ccb62a48a9</entry>
Nov 16 00:53:59 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:53:59 user nova-compute[75826]:     </system>
Nov 16 00:53:59 user nova-compute[75826]:   </sysinfo>
Nov 16 00:53:59 user nova-compute[75826]:   <os>
Nov 16 00:53:59 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:53:59 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:53:59 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:53:59 user nova-compute[75826]:   </os>
Nov 16 00:53:59 user nova-compute[75826]:   <features>
Nov 16 00:53:59 user nova-compute[75826]:     <acpi/>
Nov 16 00:53:59 user nova-compute[75826]:     <apic/>
Nov 16 00:53:59 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:53:59 user nova-compute[75826]:   </features>
Nov 16 00:53:59 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:53:59 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:53:59 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:53:59 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:53:59 user nova-compute[75826]:   </clock>
Nov 16 00:53:59 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:53:59 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:53:59 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:53:59 user nova-compute[75826]:   </cpu>
Nov 16 00:53:59 user nova-compute[75826]:   <devices>
Nov 16 00:53:59 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:53:59 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:53:59 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk"/>
Nov 16 00:53:59 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:53:59 user nova-compute[75826]:     </disk>
Nov 16 00:53:59 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:53:59 user nova-compute[75826]:       <mac address="fa:16:3e:ee:89:64"/>
Nov 16 00:53:59 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:53:59 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:53:59 user nova-compute[75826]:       <target dev="tap835bfef6-ab"/>
Nov 16 00:53:59 user nova-compute[75826]:     </interface>
Nov 16 00:53:59 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:53:59 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/console.log" append="off"/>
Nov 16 00:53:59 user nova-compute[75826]:     </serial>
Nov 16 00:53:59 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:53:59 user nova-compute[75826]:     <video>
Nov 16 00:53:59 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:53:59 user nova-compute[75826]:     </video>
Nov 16 00:53:59 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:53:59 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:53:59 user nova-compute[75826]:     </rng>
Nov 16 00:53:59 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:53:59 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:53:59 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:53:59 user nova-compute[75826]:     </memballoon>
Nov 16 00:53:59 user nova-compute[75826]:   </devices>
Nov 16 00:53:59 user nova-compute[75826]: </domain>
Nov 16 00:53:59 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1713999345',display_name='tempest-AttachVolumeTestJSON-server-1713999345',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1713999345',id=36,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeoBt67AqiEq2qRF8NLARpnjmNcoRaAiYJKRAng0U0fbJ07DiPlER8YIajLTs/sqe+gVcL9xY+4qaDzdHXH+RrZ7Y0BN20FLhE5xqPj67NfW/5RqW/gZfl7QHMb8sVU0w==',key_name='tempest-keypair-1598111726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='aa522b01f20c4d90bc4178e688319e7f',ramdisk_id='',reservation_id='r-hvio6q2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1305137356',owner_user_name='tempest-AttachVolumeTestJSON-1305137356-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:53:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96797fc178ed4c2190f7a760b3bd30bd',uuid=bdd698af-6740-4dc2-8411-54ccb62a48a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "address": "fa:16:3e:ee:89:64", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835bfef6-ab", "ovs_interfaceid": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converting VIF {"id": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "address": "fa:16:3e:ee:89:64", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835bfef6-ab", "ovs_interfaceid": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:89:64,bridge_name='br-int',has_traffic_filtering=True,id=835bfef6-ab32-4a31-b7e2-3c189e15d489,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835bfef6-ab') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG os_vif [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:89:64,bridge_name='br-int',has_traffic_filtering=True,id=835bfef6-ab32-4a31-b7e2-3c189e15d489,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835bfef6-ab') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f9106964-b8f7-5c57-b20b-0f56245356f3', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap835bfef6-ab, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap835bfef6-ab, col_values=(('qos', UUID('cb872514-68af-40f3-b52d-1b6555405607')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap835bfef6-ab, col_values=(('external_ids', {'iface-id': '835bfef6-ab32-4a31-b7e2-3c189e15d489', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:89:64', 'vm-uuid': 'bdd698af-6740-4dc2-8411-54ccb62a48a9'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:59 user nova-compute[75826]: INFO os_vif [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:89:64,bridge_name='br-int',has_traffic_filtering=True,id=835bfef6-ab32-4a31-b7e2-3c189e15d489,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835bfef6-ab')
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No VIF found with MAC fa:16:3e:ee:89:64, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.network.neutron [req-a154f499-f435-492e-8f99-9de59093d523 req-7a5e0401-60c1-4f2a-921b-df8ad6ac532c service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Updated VIF entry in instance network info cache for port 835bfef6-ab32-4a31-b7e2-3c189e15d489. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG nova.network.neutron [req-a154f499-f435-492e-8f99-9de59093d523 req-7a5e0401-60c1-4f2a-921b-df8ad6ac532c service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Updating instance_info_cache with network_info: [{"id": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "address": "fa:16:3e:ee:89:64", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835bfef6-ab", "ovs_interfaceid": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:53:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a154f499-f435-492e-8f99-9de59093d523 req-7a5e0401-60c1-4f2a-921b-df8ad6ac532c service nova] Releasing lock "refresh_cache-bdd698af-6740-4dc2-8411-54ccb62a48a9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:54:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-3b8501e3-e6c1-4823-9772-499c34ca8fce req-45ff3969-95fc-479e-bd26-19340a15ae55 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Received event network-vif-plugged-835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3b8501e3-e6c1-4823-9772-499c34ca8fce req-45ff3969-95fc-479e-bd26-19340a15ae55 service nova] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3b8501e3-e6c1-4823-9772-499c34ca8fce req-45ff3969-95fc-479e-bd26-19340a15ae55 service nova] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3b8501e3-e6c1-4823-9772-499c34ca8fce req-45ff3969-95fc-479e-bd26-19340a15ae55 service nova] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-3b8501e3-e6c1-4823-9772-499c34ca8fce req-45ff3969-95fc-479e-bd26-19340a15ae55 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] No waiting events found dispatching network-vif-plugged-835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:54:01 user nova-compute[75826]: WARNING nova.compute.manager [req-3b8501e3-e6c1-4823-9772-499c34ca8fce req-45ff3969-95fc-479e-bd26-19340a15ae55 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Received unexpected event network-vif-plugged-835bfef6-ab32-4a31-b7e2-3c189e15d489 for instance with vm_state building and task_state spawning.
Nov 16 00:54:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:02 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:54:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:54:02 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Instance spawned successfully.
Nov 16 00:54:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:54:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:54:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:54:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:54:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:54:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:54:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:54:03 user nova-compute[75826]: INFO nova.compute.manager [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Took 5.22 seconds to spawn the instance on the hypervisor.
Nov 16 00:54:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:54:03 user nova-compute[75826]: INFO nova.compute.manager [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Took 5.99 seconds to build instance.
Nov 16 00:54:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7c79b658-ad3e-48dd-9768-0c7fdd69fdaf tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.078s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-c2830087-f90b-4c30-9e82-585764a6a12a req-357308d5-96bc-4e5f-a491-5251111e971b service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Received event network-vif-plugged-835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c2830087-f90b-4c30-9e82-585764a6a12a req-357308d5-96bc-4e5f-a491-5251111e971b service nova] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c2830087-f90b-4c30-9e82-585764a6a12a req-357308d5-96bc-4e5f-a491-5251111e971b service nova] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c2830087-f90b-4c30-9e82-585764a6a12a req-357308d5-96bc-4e5f-a491-5251111e971b service nova] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-c2830087-f90b-4c30-9e82-585764a6a12a req-357308d5-96bc-4e5f-a491-5251111e971b service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] No waiting events found dispatching network-vif-plugged-835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:54:03 user nova-compute[75826]: WARNING nova.compute.manager [req-c2830087-f90b-4c30-9e82-585764a6a12a req-357308d5-96bc-4e5f-a491-5251111e971b service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Received unexpected event network-vif-plugged-835bfef6-ab32-4a31-b7e2-3c189e15d489 for instance with vm_state active and task_state None.
Nov 16 00:54:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:05 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:54:06 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-87b2703e-0154-445e-b659-5f5cf1d9f8f4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-87b2703e-0154-445e-b659-5f5cf1d9f8f4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Updating instance_info_cache with network_info: [{"id": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "address": "fa:16:3e:96:e6:37", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c45b41-fa", "ovs_interfaceid": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-87b2703e-0154-445e-b659-5f5cf1d9f8f4" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:54:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:54:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:54:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:12 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:54:12 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7267MB free_disk=25.103424072265625GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Applying migration context for instance 38a96872-51b5-448d-83c8-f722520d128c as it has an incoming, in-progress migration 58becfc1-af9d-40f4-89cf-7ba3023c6e7d. Migration status is finished {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 16 00:54:12 user nova-compute[75826]: INFO nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Updating resource usage from migration 58becfc1-af9d-40f4-89cf-7ba3023c6e7d
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 87b2703e-0154-445e-b659-5f5cf1d9f8f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance cc77d9aa-4052-40dd-9495-3a516d8f0793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 34bed458-5248-473d-b022-7f953669d85c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Migration 58becfc1-af9d-40f4-89cf-7ba3023c6e7d is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 38a96872-51b5-448d-83c8-f722520d128c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 013ad5ba-e918-4c6a-8ece-33b6e11e5e40 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance cb8a1a92-10de-4bdc-b730-83bae29ff92b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance bdd698af-6740-4dc2-8411-54ccb62a48a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:54:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:54:13 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:54:13 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:54:13 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:54:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "38a96872-51b5-448d-83c8-f722520d128c" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Going to confirm migration 2 {{(pid=75826) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 16 00:54:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:54:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquired lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:54:13 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:54:13 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lazy-loading 'info_cache' on Instance uuid 38a96872-51b5-448d-83c8-f722520d128c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Updating instance_info_cache with network_info: [{"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Releasing lock "refresh_cache-38a96872-51b5-448d-83c8-f722520d128c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lazy-loading 'migration_context' on Instance uuid 38a96872-51b5-448d-83c8-f722520d128c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG nova.objects.base [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Object Instance<38a96872-51b5-448d-83c8-f722520d128c> lazy-loaded attributes: info_cache,migration_context {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:54:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.434s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:15 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Deleted allocation for migration 58becfc1-af9d-40f4-89cf-7ba3023c6e7d
Nov 16 00:54:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4dfb94fb-11de-47b7-b875-5bd0b9608f11 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "38a96872-51b5-448d-83c8-f722520d128c" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.419s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:15 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:54:15 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:54:15 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:54:15 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:54:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:54:16 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:54:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:54:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 00:54:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:54:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:54:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:21 user nova-compute[75826]: INFO nova.compute.manager [None req-7da4c8d0-c1e5-4073-babe-42b2ee28fd5c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Unrescuing
Nov 16 00:54:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7da4c8d0-c1e5-4073-babe-42b2ee28fd5c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "refresh_cache-34bed458-5248-473d-b022-7f953669d85c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:54:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7da4c8d0-c1e5-4073-babe-42b2ee28fd5c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquired lock "refresh_cache-34bed458-5248-473d-b022-7f953669d85c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:54:21 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7da4c8d0-c1e5-4073-babe-42b2ee28fd5c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:54:21 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7da4c8d0-c1e5-4073-babe-42b2ee28fd5c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Updating instance_info_cache with network_info: [{"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:54:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7da4c8d0-c1e5-4073-babe-42b2ee28fd5c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Releasing lock "refresh_cache-34bed458-5248-473d-b022-7f953669d85c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:54:21 user nova-compute[75826]: DEBUG nova.objects.instance [None req-7da4c8d0-c1e5-4073-babe-42b2ee28fd5c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'flavor' on Instance uuid 34bed458-5248-473d-b022-7f953669d85c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:54:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-0e88b27c-88cf-4893-b2cf-d29fe60f9a06 req-8d476d36-307f-4235-b5c9-3802d53a275d service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-unplugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0e88b27c-88cf-4893-b2cf-d29fe60f9a06 req-8d476d36-307f-4235-b5c9-3802d53a275d service nova] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0e88b27c-88cf-4893-b2cf-d29fe60f9a06 req-8d476d36-307f-4235-b5c9-3802d53a275d service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0e88b27c-88cf-4893-b2cf-d29fe60f9a06 req-8d476d36-307f-4235-b5c9-3802d53a275d service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-0e88b27c-88cf-4893-b2cf-d29fe60f9a06 req-8d476d36-307f-4235-b5c9-3802d53a275d service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] No waiting events found dispatching network-vif-unplugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:54:22 user nova-compute[75826]: WARNING nova.compute.manager [req-0e88b27c-88cf-4893-b2cf-d29fe60f9a06 req-8d476d36-307f-4235-b5c9-3802d53a275d service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received unexpected event network-vif-unplugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e for instance with vm_state rescued and task_state unrescuing.
Nov 16 00:54:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:22 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 34bed458-5248-473d-b022-7f953669d85c] Instance destroyed successfully.
Nov 16 00:54:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-96108065-efaa-4ba1-a701-657ddebc0533 req-82bafed7-7f1c-4eaf-b822-0283430efc34 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-96108065-efaa-4ba1-a701-657ddebc0533 req-82bafed7-7f1c-4eaf-b822-0283430efc34 service nova] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-96108065-efaa-4ba1-a701-657ddebc0533 req-82bafed7-7f1c-4eaf-b822-0283430efc34 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-96108065-efaa-4ba1-a701-657ddebc0533 req-82bafed7-7f1c-4eaf-b822-0283430efc34 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-96108065-efaa-4ba1-a701-657ddebc0533 req-82bafed7-7f1c-4eaf-b822-0283430efc34 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] No waiting events found dispatching network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:54:24 user nova-compute[75826]: WARNING nova.compute.manager [req-96108065-efaa-4ba1-a701-657ddebc0533 req-82bafed7-7f1c-4eaf-b822-0283430efc34 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received unexpected event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e for instance with vm_state rescued and task_state unrescuing.
Nov 16 00:54:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-96108065-efaa-4ba1-a701-657ddebc0533 req-82bafed7-7f1c-4eaf-b822-0283430efc34 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-96108065-efaa-4ba1-a701-657ddebc0533 req-82bafed7-7f1c-4eaf-b822-0283430efc34 service nova] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-96108065-efaa-4ba1-a701-657ddebc0533 req-82bafed7-7f1c-4eaf-b822-0283430efc34 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-96108065-efaa-4ba1-a701-657ddebc0533 req-82bafed7-7f1c-4eaf-b822-0283430efc34 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-96108065-efaa-4ba1-a701-657ddebc0533 req-82bafed7-7f1c-4eaf-b822-0283430efc34 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] No waiting events found dispatching network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:54:24 user nova-compute[75826]: WARNING nova.compute.manager [req-96108065-efaa-4ba1-a701-657ddebc0533 req-82bafed7-7f1c-4eaf-b822-0283430efc34 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received unexpected event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e for instance with vm_state rescued and task_state unrescuing.
Nov 16 00:54:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7da4c8d0-c1e5-4073-babe-42b2ee28fd5c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:54:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-c16b16be-d57a-4ad6-9f0a-21be56a0c547 req-dd214d13-048f-4570-afde-9185e7a62e5c service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c16b16be-d57a-4ad6-9f0a-21be56a0c547 req-dd214d13-048f-4570-afde-9185e7a62e5c service nova] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c16b16be-d57a-4ad6-9f0a-21be56a0c547 req-dd214d13-048f-4570-afde-9185e7a62e5c service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c16b16be-d57a-4ad6-9f0a-21be56a0c547 req-dd214d13-048f-4570-afde-9185e7a62e5c service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-c16b16be-d57a-4ad6-9f0a-21be56a0c547 req-dd214d13-048f-4570-afde-9185e7a62e5c service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] No waiting events found dispatching network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:54:26 user nova-compute[75826]: WARNING nova.compute.manager [req-c16b16be-d57a-4ad6-9f0a-21be56a0c547 req-dd214d13-048f-4570-afde-9185e7a62e5c service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received unexpected event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e for instance with vm_state active and task_state None.
Nov 16 00:54:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:31 user nova-compute[75826]: INFO nova.compute.manager [None req-69f500d5-f47f-46f5-842d-ffb169a44e2f tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Unrescuing
Nov 16 00:54:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-69f500d5-f47f-46f5-842d-ffb169a44e2f tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:54:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-69f500d5-f47f-46f5-842d-ffb169a44e2f tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquired lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:54:31 user nova-compute[75826]: DEBUG nova.network.neutron [None req-69f500d5-f47f-46f5-842d-ffb169a44e2f tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:54:32 user nova-compute[75826]: DEBUG nova.network.neutron [None req-69f500d5-f47f-46f5-842d-ffb169a44e2f tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Updating instance_info_cache with network_info: [{"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:54:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-69f500d5-f47f-46f5-842d-ffb169a44e2f tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Releasing lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:54:32 user nova-compute[75826]: DEBUG nova.objects.instance [None req-69f500d5-f47f-46f5-842d-ffb169a44e2f tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'flavor' on Instance uuid 574817b0-a25c-4da1-9ce6-804008e8279c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:54:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:32 user nova-compute[75826]: DEBUG nova.compute.manager [req-26883d77-1916-4a86-9ffc-c7df8ca469d3 req-49485b49-a96c-453f-88cb-f0ca6338a789 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-unplugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-26883d77-1916-4a86-9ffc-c7df8ca469d3 req-49485b49-a96c-453f-88cb-f0ca6338a789 service nova] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-26883d77-1916-4a86-9ffc-c7df8ca469d3 req-49485b49-a96c-453f-88cb-f0ca6338a789 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-26883d77-1916-4a86-9ffc-c7df8ca469d3 req-49485b49-a96c-453f-88cb-f0ca6338a789 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:32 user nova-compute[75826]: DEBUG nova.compute.manager [req-26883d77-1916-4a86-9ffc-c7df8ca469d3 req-49485b49-a96c-453f-88cb-f0ca6338a789 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] No waiting events found dispatching network-vif-unplugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:54:32 user nova-compute[75826]: WARNING nova.compute.manager [req-26883d77-1916-4a86-9ffc-c7df8ca469d3 req-49485b49-a96c-453f-88cb-f0ca6338a789 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received unexpected event network-vif-unplugged-c7936822-0ba8-4241-9e2b-1977e21eba80 for instance with vm_state rescued and task_state unrescuing.
Nov 16 00:54:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:32 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Instance destroyed successfully.
Nov 16 00:54:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:33 user nova-compute[75826]: INFO nova.compute.manager [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Terminating instance
Nov 16 00:54:33 user nova-compute[75826]: DEBUG nova.compute.manager [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:54:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-6b3ec2a5-a39c-4881-906d-e15bae7a08e8 req-45f812bf-92f2-479b-9273-ff98412cd2eb service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Received event network-vif-unplugged-a0c420ba-1f56-4b44-ac55-73a89368402b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6b3ec2a5-a39c-4881-906d-e15bae7a08e8 req-45f812bf-92f2-479b-9273-ff98412cd2eb service nova] Acquiring lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6b3ec2a5-a39c-4881-906d-e15bae7a08e8 req-45f812bf-92f2-479b-9273-ff98412cd2eb service nova] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6b3ec2a5-a39c-4881-906d-e15bae7a08e8 req-45f812bf-92f2-479b-9273-ff98412cd2eb service nova] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-6b3ec2a5-a39c-4881-906d-e15bae7a08e8 req-45f812bf-92f2-479b-9273-ff98412cd2eb service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] No waiting events found dispatching network-vif-unplugged-a0c420ba-1f56-4b44-ac55-73a89368402b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-6b3ec2a5-a39c-4881-906d-e15bae7a08e8 req-45f812bf-92f2-479b-9273-ff98412cd2eb service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Received event network-vif-unplugged-a0c420ba-1f56-4b44-ac55-73a89368402b for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-0097c243-69c8-4820-8e30-24a09b66ba2a req-b60fc6eb-9916-46e8-88c7-9d3aafd0ec5f service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0097c243-69c8-4820-8e30-24a09b66ba2a req-b60fc6eb-9916-46e8-88c7-9d3aafd0ec5f service nova] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0097c243-69c8-4820-8e30-24a09b66ba2a req-b60fc6eb-9916-46e8-88c7-9d3aafd0ec5f service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0097c243-69c8-4820-8e30-24a09b66ba2a req-b60fc6eb-9916-46e8-88c7-9d3aafd0ec5f service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-0097c243-69c8-4820-8e30-24a09b66ba2a req-b60fc6eb-9916-46e8-88c7-9d3aafd0ec5f service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] No waiting events found dispatching network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:54:34 user nova-compute[75826]: WARNING nova.compute.manager [req-0097c243-69c8-4820-8e30-24a09b66ba2a req-b60fc6eb-9916-46e8-88c7-9d3aafd0ec5f service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received unexpected event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 for instance with vm_state rescued and task_state unrescuing.
Nov 16 00:54:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-0097c243-69c8-4820-8e30-24a09b66ba2a req-b60fc6eb-9916-46e8-88c7-9d3aafd0ec5f service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0097c243-69c8-4820-8e30-24a09b66ba2a req-b60fc6eb-9916-46e8-88c7-9d3aafd0ec5f service nova] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0097c243-69c8-4820-8e30-24a09b66ba2a req-b60fc6eb-9916-46e8-88c7-9d3aafd0ec5f service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0097c243-69c8-4820-8e30-24a09b66ba2a req-b60fc6eb-9916-46e8-88c7-9d3aafd0ec5f service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-0097c243-69c8-4820-8e30-24a09b66ba2a req-b60fc6eb-9916-46e8-88c7-9d3aafd0ec5f service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] No waiting events found dispatching network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:54:34 user nova-compute[75826]: WARNING nova.compute.manager [req-0097c243-69c8-4820-8e30-24a09b66ba2a req-b60fc6eb-9916-46e8-88c7-9d3aafd0ec5f service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received unexpected event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 for instance with vm_state rescued and task_state unrescuing.
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Instance destroyed successfully.
Nov 16 00:54:34 user nova-compute[75826]: DEBUG nova.objects.instance [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lazy-loading 'resources' on Instance uuid 013ad5ba-e918-4c6a-8ece-33b6e11e5e40 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:52:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1327463880',display_name='tempest-TestVolumeBootPattern-server-1327463880',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1327463880',id=34,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:53:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-4dllluok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:53:01Z,user_data=None,user_id='6c17265442bc48f9b6de5367e91096b2',uuid=013ad5ba-e918-4c6a-8ece-33b6e11e5e40,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0c420ba-1f56-4b44-ac55-73a89368402b", "address": "fa:16:3e:32:c6:81", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c420ba-1f", "ovs_interfaceid": "a0c420ba-1f56-4b44-ac55-73a89368402b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "a0c420ba-1f56-4b44-ac55-73a89368402b", "address": "fa:16:3e:32:c6:81", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0c420ba-1f", "ovs_interfaceid": "a0c420ba-1f56-4b44-ac55-73a89368402b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:32:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=a0c420ba-1f56-4b44-ac55-73a89368402b,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c420ba-1f') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_vif [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=a0c420ba-1f56-4b44-ac55-73a89368402b,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c420ba-1f') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0c420ba-1f, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=70d572ff-2e9d-41de-90f5-b63ca312b04b) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:34 user nova-compute[75826]: INFO os_vif [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:32:c6:81,bridge_name='br-int',has_traffic_filtering=True,id=a0c420ba-1f56-4b44-ac55-73a89368402b,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0c420ba-1f')
Nov 16 00:54:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CvbkDGHz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:54:34 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f2f83c6-6992-4de5-956c-8cabe8d49149]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:54:34 user nova-compute[75826]: No targets found.
Nov 16 00:54:34 user nova-compute[75826]: iSNS:
Nov 16 00:54:34 user nova-compute[75826]: No targets found.
Nov 16 00:54:34 user nova-compute[75826]: STATIC:
Nov 16 00:54:34 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc
Nov 16 00:54:34 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:54:34 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:54:34 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9
Nov 16 00:54:34 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:54:34 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:54:34 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:54:34 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:54:34 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:54:34 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9
Nov 16 00:54:34 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:54:34 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:54:34 user nova-compute[75826]: FIRMWARE:
Nov 16 00:54:34 user nova-compute[75826]: No targets found.
Nov 16 00:54:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:54:34 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:54:34 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3466cd8-162a-4b65-bdab-a852e74d6066]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[091a3ad7-b9f4-49df-a4dc-83e4683f3004]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:54:34 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:54:34 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:54:34 user nova-compute[75826]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 (non-flash)
Nov 16 00:54:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:54:34 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:54:34 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:54:34 user nova-compute[75826]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 (non-flash)
Nov 16 00:54:34 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd942cadd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9'): ({'sdd'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Removing single pathed devices sdd {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0b46f0-8dea-46cd-82f1-403408b61eae]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c3a5a6-c094-4082-8158-bd822872476c]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flushing IO for device /dev/sdd {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d131d7-5d94-49f1-bb8c-97b26d4339f4]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6623b4d6-96b6-42a5-b0f2-5153c3f3eb78]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:54:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[039a3ad4-0a03-459b-a379-1a7da01b7738]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c77f176-cf0e-4113-b8ba-ec7d83d9f5e3]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9, portal: 172.16.0.220,3260]
Nov 16 00:54:35 user nova-compute[75826]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9, portal: 172.16.0.220,3260] successful.
Nov 16 00:54:35 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1c56ae35-755a-49b8-988e-8edf866194f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c121f1ea-d5c1-4f5d-83c7-9bc97b6d3dda]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== disconnect_volume: return (349ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:54:35 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Deleting instance files /opt/stack/data/nova/instances/013ad5ba-e918-4c6a-8ece-33b6e11e5e40_del
Nov 16 00:54:35 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Deletion of /opt/stack/data/nova/instances/013ad5ba-e918-4c6a-8ece-33b6e11e5e40_del complete
Nov 16 00:54:35 user nova-compute[75826]: INFO nova.compute.manager [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 16 00:54:35 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:54:35 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:54:35 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Took 0.54 seconds to deallocate network for instance.
Nov 16 00:54:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-738d1cb7-034f-40d9-a91e-da6c2c47dc18 req-63d7a071-a35a-4966-8dd5-16711508b1fb service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Received event network-vif-plugged-a0c420ba-1f56-4b44-ac55-73a89368402b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-738d1cb7-034f-40d9-a91e-da6c2c47dc18 req-63d7a071-a35a-4966-8dd5-16711508b1fb service nova] Acquiring lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-738d1cb7-034f-40d9-a91e-da6c2c47dc18 req-63d7a071-a35a-4966-8dd5-16711508b1fb service nova] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-738d1cb7-034f-40d9-a91e-da6c2c47dc18 req-63d7a071-a35a-4966-8dd5-16711508b1fb service nova] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-738d1cb7-034f-40d9-a91e-da6c2c47dc18 req-63d7a071-a35a-4966-8dd5-16711508b1fb service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] No waiting events found dispatching network-vif-plugged-a0c420ba-1f56-4b44-ac55-73a89368402b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:54:36 user nova-compute[75826]: WARNING nova.compute.manager [req-738d1cb7-034f-40d9-a91e-da6c2c47dc18 req-63d7a071-a35a-4966-8dd5-16711508b1fb service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Received unexpected event network-vif-plugged-a0c420ba-1f56-4b44-ac55-73a89368402b for instance with vm_state active and task_state deleting.
Nov 16 00:54:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-738d1cb7-034f-40d9-a91e-da6c2c47dc18 req-63d7a071-a35a-4966-8dd5-16711508b1fb service nova] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Received event network-vif-deleted-a0c420ba-1f56-4b44-ac55-73a89368402b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-d016e69e-f3dd-4d73-ab50-60ba2742db07 req-5758798d-27b2-4098-85a3-13440a8a8e2e service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d016e69e-f3dd-4d73-ab50-60ba2742db07 req-5758798d-27b2-4098-85a3-13440a8a8e2e service nova] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d016e69e-f3dd-4d73-ab50-60ba2742db07 req-5758798d-27b2-4098-85a3-13440a8a8e2e service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d016e69e-f3dd-4d73-ab50-60ba2742db07 req-5758798d-27b2-4098-85a3-13440a8a8e2e service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-d016e69e-f3dd-4d73-ab50-60ba2742db07 req-5758798d-27b2-4098-85a3-13440a8a8e2e service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] No waiting events found dispatching network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:54:36 user nova-compute[75826]: WARNING nova.compute.manager [req-d016e69e-f3dd-4d73-ab50-60ba2742db07 req-5758798d-27b2-4098-85a3-13440a8a8e2e service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received unexpected event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 for instance with vm_state rescued and task_state unrescuing.
Nov 16 00:54:36 user nova-compute[75826]: DEBUG nova.compute.manager [None req-69f500d5-f47f-46f5-842d-ffb169a44e2f tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:54:36 user nova-compute[75826]: INFO nova.compute.manager [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Took 1.00 seconds to detach 1 volumes for instance.
Nov 16 00:54:36 user nova-compute[75826]: DEBUG nova.compute.manager [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 013ad5ba-e918-4c6a-8ece-33b6e11e5e40] Deleting volume: 1c56ae35-755a-49b8-988e-8edf866194f9 {{(pid=75826) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 00:54:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:37 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:54:37 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:54:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.509s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:37 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Deleted allocations for instance 013ad5ba-e918-4c6a-8ece-33b6e11e5e40
Nov 16 00:54:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-41de6e96-9331-4f75-8e3d-4b2f421e455f tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "013ad5ba-e918-4c6a-8ece-33b6e11e5e40" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.627s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-fd705ecf-40e2-4869-b452-6ca8c5ac68e1 req-1f7b70e0-254d-449c-9ada-67025bc3294f service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Received event network-changed-63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:54:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-fd705ecf-40e2-4869-b452-6ca8c5ac68e1 req-1f7b70e0-254d-449c-9ada-67025bc3294f service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Refreshing instance network info cache due to event network-changed-63798638-71ff-4e72-864c-d73d5e82104a. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:54:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fd705ecf-40e2-4869-b452-6ca8c5ac68e1 req-1f7b70e0-254d-449c-9ada-67025bc3294f service nova] Acquiring lock "refresh_cache-45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:54:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fd705ecf-40e2-4869-b452-6ca8c5ac68e1 req-1f7b70e0-254d-449c-9ada-67025bc3294f service nova] Acquired lock "refresh_cache-45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:54:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-fd705ecf-40e2-4869-b452-6ca8c5ac68e1 req-1f7b70e0-254d-449c-9ada-67025bc3294f service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Refreshing network info cache for port 63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:54:42 user nova-compute[75826]: DEBUG nova.network.neutron [req-fd705ecf-40e2-4869-b452-6ca8c5ac68e1 req-1f7b70e0-254d-449c-9ada-67025bc3294f service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Updated VIF entry in instance network info cache for port 63798638-71ff-4e72-864c-d73d5e82104a. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:54:42 user nova-compute[75826]: DEBUG nova.network.neutron [req-fd705ecf-40e2-4869-b452-6ca8c5ac68e1 req-1f7b70e0-254d-449c-9ada-67025bc3294f service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Updating instance_info_cache with network_info: [{"id": "63798638-71ff-4e72-864c-d73d5e82104a", "address": "fa:16:3e:5d:ba:e7", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63798638-71", "ovs_interfaceid": "63798638-71ff-4e72-864c-d73d5e82104a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:54:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fd705ecf-40e2-4869-b452-6ca8c5ac68e1 req-1f7b70e0-254d-449c-9ada-67025bc3294f service nova] Releasing lock "refresh_cache-45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG nova.objects.instance [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'flavor' on Instance uuid 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:43 user nova-compute[75826]: INFO nova.compute.manager [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Attaching volume 1dbec8e3-164f-43e4-b02e-972a54ad2359 to /dev/vdb
Nov 16 00:54:43 user nova-compute[75826]: DEBUG os_brick.utils [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d937a92-a456-40a8-b7f1-d659b3ce2eba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8788cb-a57a-47b7-9752-4c64788c5b5c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[375c1cac-f33a-49d4-9ea2-5410b844ab28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3882e2a7-e960-45c3-b20b-0c1da4c1a76e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:54:43 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:54:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b284493e-1a88-43d4-853d-58bea2133454]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG os_brick.utils [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:54:43 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Updating existing volume attachment record: 61edb346-d265-443c-b3b5-ab0f9473c588 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:54:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycrqXpsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:54:50 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:54:50 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:54:50 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7948c56-1873-45e8-92a3-d7acd15c142e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:54:50 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c5bf25-9cfd-42bd-800a-0527c9568f3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359] added
Nov 16 00:54:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd4e20c-6b8d-4101-897c-1fc6338986b8]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10c762d-35e8-497b-9a9d-56876591503e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycrqXpsm {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ycrqXpsm" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[099eb997-43ae-4852-af4b-9e08f14796d5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ycrqXpsm'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb55dd1-6625-448e-bc3c-abeb42e46ca3]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd62888-c486-4a72-b938-af6149a30001]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:54:50 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:54:50 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:54:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:54:50 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:54:50 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:54:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[735a3eb8-de14-49ac-8ec5-2407da90a0c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359, portal: 172.16.0.220,3260]
Nov 16 00:54:50 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359, portal: 172.16.0.220,3260] successful.
Nov 16 00:54:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8901299f-6685-4f75-9468-bfdd0c10496d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe9efec-ff51-46fe-a292-19301c75a35a]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:54:50 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:54:50 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:54:50 user nova-compute[75826]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 (non-flash)
Nov 16 00:54:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:54:50 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:54:50 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:54:50 user nova-compute[75826]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 (non-flash)
Nov 16 00:54:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfafa999-1c1f-4afa-84ae-5b35a05d52ef]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:54:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycrqXpsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:54:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:54:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26562663436663732', 'path': '/dev/sdd'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:54:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562663436663732', 'path': '/dev/sdd'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:54:51 user nova-compute[75826]: DEBUG nova.objects.instance [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'flavor' on Instance uuid 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:54:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:54:51 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:54:51 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 00:54:51 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:54:51 user nova-compute[75826]:   <serial>1dbec8e3-164f-43e4-b02e-972a54ad2359</serial>
Nov 16 00:54:51 user nova-compute[75826]: </disk>
Nov 16 00:54:51 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:54:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:54:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:54:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No VIF found with MAC fa:16:3e:5d:ba:e7, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:54:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ef8e2957-0100-4400-82e4-2ebc3fb7b7e7 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.441s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:54:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:54:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:54:52 user nova-compute[75826]: INFO nova.compute.manager [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Detaching volume 1dbec8e3-164f-43e4-b02e-972a54ad2359
Nov 16 00:54:52 user nova-compute[75826]: INFO nova.virt.block_device [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Attempting to driver detach volume 1dbec8e3-164f-43e4-b02e-972a54ad2359 from mountpoint /dev/vdb
Nov 16 00:54:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Attempting to detach device vdb from instance 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:54:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:54:52 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:54:52 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 00:54:52 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:54:52 user nova-compute[75826]:   <serial>1dbec8e3-164f-43e4-b02e-972a54ad2359</serial>
Nov 16 00:54:52 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:54:52 user nova-compute[75826]: </disk>
Nov 16 00:54:52 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:54:52 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully detached device vdb from instance 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 from the persistent domain config.
Nov 16 00:54:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:54:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:54:52 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:54:52 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 00:54:52 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:54:52 user nova-compute[75826]:   <serial>1dbec8e3-164f-43e4-b02e-972a54ad2359</serial>
Nov 16 00:54:52 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:54:52 user nova-compute[75826]: </disk>
Nov 16 00:54:52 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:54:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:54:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:54:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:05 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:55:07 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:55:07 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:55:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:55:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:55:07 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:55:07 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Updating instance_info_cache with network_info: [{"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:55:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:55:07 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:55:07 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b/disk --force-share --output=json" returned: 0 in 0.299s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:12 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:55:12 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7405MB free_disk=25.074207305908203GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 87b2703e-0154-445e-b659-5f5cf1d9f8f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance cc77d9aa-4052-40dd-9495-3a516d8f0793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 34bed458-5248-473d-b022-7f953669d85c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 38a96872-51b5-448d-83c8-f722520d128c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance cb8a1a92-10de-4bdc-b730-83bae29ff92b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance bdd698af-6740-4dc2-8411-54ccb62a48a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing inventories for resource provider 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating ProviderTree inventory for provider 015246d3-5250-41ea-8943-b837ba3f5938 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating inventory in ProviderTree for provider 015246d3-5250-41ea-8943-b837ba3f5938 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing aggregate associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, aggregates: None {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 00:55:12 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing trait associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.653s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:55:13 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 is timed out.
Nov 16 00:55:13 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully detached device vdb from instance 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 from the live domain config.
Nov 16 00:55:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ycrqXpsm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:55:13 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[19913b17-de44-4b22-820e-b3378c7419e9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:55:13 user nova-compute[75826]: No targets found.
Nov 16 00:55:13 user nova-compute[75826]: iSNS:
Nov 16 00:55:13 user nova-compute[75826]: No targets found.
Nov 16 00:55:13 user nova-compute[75826]: STATIC:
Nov 16 00:55:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc
Nov 16 00:55:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:55:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:55:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9
Nov 16 00:55:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:55:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:55:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359
Nov 16 00:55:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:55:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:55:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:55:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:55:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:55:13 user nova-compute[75826]: FIRMWARE:
Nov 16 00:55:13 user nova-compute[75826]: No targets found.
Nov 16 00:55:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:55:13 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:55:13 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f817cf4b-8895-4aae-b31b-966dc2ce629f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee037ee-07d6-447f-b858-b86303640899]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:55:13 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:55:13 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:55:13 user nova-compute[75826]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 (non-flash)
Nov 16 00:55:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:55:13 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:55:13 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:55:13 user nova-compute[75826]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 (non-flash)
Nov 16 00:55:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd944a3be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359'): ({'sdd'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Removing single pathed devices sdd {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[df31c78a-47dd-429e-9263-648e73d58880]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3addbf5b-2efc-4f22-a12e-66679d6b7032]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Flushing IO for device /dev/sdd {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4243d03b-f6d7-400e-9ca9-f730c45ce3e5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b295bb75-7fc7-4f93-b38b-86af47faff46]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0392bc41-7e2d-4492-9786-5672a15e02ab]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac03dd78-8eb7-4fdf-977d-799374392cab]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359, portal: 172.16.0.220,3260]
Nov 16 00:55:13 user nova-compute[75826]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359, portal: 172.16.0.220,3260] successful.
Nov 16 00:55:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1dbec8e3-164f-43e4-b02e-972a54ad2359 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61c410b-8ef0-4cca-b50c-7531b3b1aef6]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] <== disconnect_volume: return (305ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:55:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG nova.objects.instance [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'flavor' on Instance uuid 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-1147704d-d5d2-449e-ae9d-cc3c4dabf76f tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.649s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:14 user nova-compute[75826]: INFO nova.compute.manager [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Terminating instance
Nov 16 00:55:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-332e08e4-21b4-49ef-86e6-94ee175744fb req-0ba1265e-0d2c-41f9-a40b-101f18418ea5 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-vif-unplugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-332e08e4-21b4-49ef-86e6-94ee175744fb req-0ba1265e-0d2c-41f9-a40b-101f18418ea5 service nova] Acquiring lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-332e08e4-21b4-49ef-86e6-94ee175744fb req-0ba1265e-0d2c-41f9-a40b-101f18418ea5 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-332e08e4-21b4-49ef-86e6-94ee175744fb req-0ba1265e-0d2c-41f9-a40b-101f18418ea5 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-332e08e4-21b4-49ef-86e6-94ee175744fb req-0ba1265e-0d2c-41f9-a40b-101f18418ea5 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] No waiting events found dispatching network-vif-unplugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-332e08e4-21b4-49ef-86e6-94ee175744fb req-0ba1265e-0d2c-41f9-a40b-101f18418ea5 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-vif-unplugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:15 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Instance destroyed successfully.
Nov 16 00:55:15 user nova-compute[75826]: DEBUG nova.objects.instance [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lazy-loading 'resources' on Instance uuid cb8a1a92-10de-4bdc-b730-83bae29ff92b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T00:49:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1266665264',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1266665264',id=30,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAkKOKHpjmxVwP9V7adtdz4VQBjXn7APViT1VzpK4o4RhMiapzvLBqHFVkjHnA+c0rjxqezFUAS25kHTzDm+npNVmmZXmRGAI3ibU+T6quMQQhJNAm2BD/LbwCTKFPZM3A==',key_name='tempest-keypair-1217439759',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:53:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c770637392a544c48a72c953bfd9e7c6',ramdisk_id='',reservation_id='r-ip881mu4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1849437325',owner_user_name='tempest-AttachVolumeShelveTestJSON-1849437325-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:53:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a858d73834524c86a1c5c8514270761e',uuid=cb8a1a92-10de-4bdc-b730-83bae29ff92b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converting VIF {"id": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "address": "fa:16:3e:cc:63:f5", "network": {"id": "bfe5375d-15f3-432f-ae98-b7bdb5f42429", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-404211036-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c770637392a544c48a72c953bfd9e7c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c4ad1d8-e2", "ovs_interfaceid": "5c4ad1d8-e2df-47a7-9305-538ad370dfba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG os_vif [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c4ad1d8-e2, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ecceae31-a014-46b1-ae98-91d7bf0fd111) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:15 user nova-compute[75826]: INFO os_vif [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:63:f5,bridge_name='br-int',has_traffic_filtering=True,id=5c4ad1d8-e2df-47a7-9305-538ad370dfba,network=Network(bfe5375d-15f3-432f-ae98-b7bdb5f42429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c4ad1d8-e2')
Nov 16 00:55:15 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Deleting instance files /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b_del
Nov 16 00:55:15 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Deletion of /opt/stack/data/nova/instances/cb8a1a92-10de-4bdc-b730-83bae29ff92b_del complete
Nov 16 00:55:15 user nova-compute[75826]: INFO nova.compute.manager [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Took 0.70 seconds to destroy the instance on the hypervisor.
Nov 16 00:55:15 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:55:15 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Took 0.69 seconds to deallocate network for instance.
Nov 16 00:55:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75826) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:16 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Deleted allocations for instance cb8a1a92-10de-4bdc-b730-83bae29ff92b
Nov 16 00:55:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ffb2dc24-8d05-4636-97aa-47eca61a2f4d tempest-AttachVolumeShelveTestJSON-1849437325 tempest-AttachVolumeShelveTestJSON-1849437325-project-member] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.946s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG nova.compute.manager [req-e0ea0959-6388-42e6-84c3-799ba6653a1f req-19902f16-bed8-4475-b390-a25a1b434ee6 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e0ea0959-6388-42e6-84c3-799ba6653a1f req-19902f16-bed8-4475-b390-a25a1b434ee6 service nova] Acquiring lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e0ea0959-6388-42e6-84c3-799ba6653a1f req-19902f16-bed8-4475-b390-a25a1b434ee6 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e0ea0959-6388-42e6-84c3-799ba6653a1f req-19902f16-bed8-4475-b390-a25a1b434ee6 service nova] Lock "cb8a1a92-10de-4bdc-b730-83bae29ff92b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:16 user nova-compute[75826]: DEBUG nova.compute.manager [req-e0ea0959-6388-42e6-84c3-799ba6653a1f req-19902f16-bed8-4475-b390-a25a1b434ee6 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] No waiting events found dispatching network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:55:16 user nova-compute[75826]: WARNING nova.compute.manager [req-e0ea0959-6388-42e6-84c3-799ba6653a1f req-19902f16-bed8-4475-b390-a25a1b434ee6 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received unexpected event network-vif-plugged-5c4ad1d8-e2df-47a7-9305-538ad370dfba for instance with vm_state deleted and task_state None.
Nov 16 00:55:16 user nova-compute[75826]: DEBUG nova.compute.manager [req-e0ea0959-6388-42e6-84c3-799ba6653a1f req-19902f16-bed8-4475-b390-a25a1b434ee6 service nova] [instance: cb8a1a92-10de-4bdc-b730-83bae29ff92b] Received event network-vif-deleted-5c4ad1d8-e2df-47a7-9305-538ad370dfba {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:55:18 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:55:18 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:55:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:55:21 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 00:55:21 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] There are 0 instances to clean {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 00:55:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:55:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG nova.compute.manager [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:55:37 user nova-compute[75826]: INFO nova.compute.claims [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Claim successful on node user
Nov 16 00:55:37 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG nova.compute.manager [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG nova.compute.manager [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG nova.network.neutron [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:55:37 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:55:37 user nova-compute[75826]: DEBUG nova.compute.manager [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG nova.policy [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c17265442bc48f9b6de5367e91096b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4135693756414fb70826b0f1d9345c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:55:37 user nova-compute[75826]: INFO nova.virt.block_device [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Booting with volume 75914f2c-118c-4b41-93fb-79305d33dab9 at /dev/vda
Nov 16 00:55:37 user nova-compute[75826]: DEBUG os_brick.utils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[125f03b4-c51b-4119-b1fd-235120942d7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1364f6d2-b895-4ed8-9f98-832c3580d2c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[012d484c-6e38-4179-827d-cb00dffdd05a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[33426c31-3116-4d88-ac37-4dcf5b6a172b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:55:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:55:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:55:38 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:55:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec175124-ba04-4452-b6b5-9d4eda44f49e]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:55:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:55:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:55:38 user nova-compute[75826]: DEBUG os_brick.utils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:55:38 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Updating existing volume attachment record: 2c617794-2e41-4538-a226-4a79bb40c845 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:55:38 user nova-compute[75826]: DEBUG nova.network.neutron [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Successfully created port: 65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Successfully updated port: 65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "refresh_cache-24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquired lock "refresh_cache-24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-e559dfcb-f25a-49a4-b1a2-d2c648a31489 req-b306ee0f-eba8-43fc-990e-129a2fe2323a service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received event network-changed-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-e559dfcb-f25a-49a4-b1a2-d2c648a31489 req-b306ee0f-eba8-43fc-990e-129a2fe2323a service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Refreshing instance network info cache due to event network-changed-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e559dfcb-f25a-49a4-b1a2-d2c648a31489 req-b306ee0f-eba8-43fc-990e-129a2fe2323a service nova] Acquiring lock "refresh_cache-24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Updating instance_info_cache with network_info: [{"id": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "address": "fa:16:3e:f7:30:c4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bc56ab-de", "ovs_interfaceid": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Releasing lock "refresh_cache-24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Instance network_info: |[{"id": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "address": "fa:16:3e:f7:30:c4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bc56ab-de", "ovs_interfaceid": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e559dfcb-f25a-49a4-b1a2-d2c648a31489 req-b306ee0f-eba8-43fc-990e-129a2fe2323a service nova] Acquired lock "refresh_cache-24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG nova.network.neutron [req-e559dfcb-f25a-49a4-b1a2-d2c648a31489 req-b306ee0f-eba8-43fc-990e-129a2fe2323a service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Refreshing network info cache for port 65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG nova.network.neutron [req-e559dfcb-f25a-49a4-b1a2-d2c648a31489 req-b306ee0f-eba8-43fc-990e-129a2fe2323a service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Updated VIF entry in instance network info cache for port 65bc56ab-de8e-44dc-938b-1bb5d84d7fcb. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG nova.network.neutron [req-e559dfcb-f25a-49a4-b1a2-d2c648a31489 req-b306ee0f-eba8-43fc-990e-129a2fe2323a service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Updating instance_info_cache with network_info: [{"id": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "address": "fa:16:3e:f7:30:c4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bc56ab-de", "ovs_interfaceid": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:55:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e559dfcb-f25a-49a4-b1a2-d2c648a31489 req-b306ee0f-eba8-43fc-990e-129a2fe2323a service nova] Releasing lock "refresh_cache-24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:55:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:43 user nova-compute[75826]: INFO nova.compute.manager [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Terminating instance
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.compute.manager [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.compute.manager [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:55:43 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Creating image(s)
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Ensure instance console log exists: /opt/stack/data/nova/instances/24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Start _get_guest_xml network_info=[{"id": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "address": "fa:16:3e:f7:30:c4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bc56ab-de", "ovs_interfaceid": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '2c617794-2e41-4538-a226-4a79bb40c845', 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YfjsiECh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a', 'attached_at': '', 'detached_at': '', 'volume_id': '75914f2c-118c-4b41-93fb-79305d33dab9', 'serial': '75914f2c-118c-4b41-93fb-79305d33dab9'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:55:43 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:55:43 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YfjsiECh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:55:43 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:55:43 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:55:43 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:55:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4cc38ac-2146-440f-be6a-fce4c15bb4fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:55:43 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae646ed-9562-4b23-b63a-df45075f560f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9] added
Nov 16 00:55:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e300af4b-72d3-4806-b9de-281c5aaf094c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbb4920-efd6-400c-9ed9-bbff6ac811f1]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YfjsiECh {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YfjsiECh" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66a024c-5d93-419b-8776-b054f46c22a8]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YfjsiECh'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[427df6bc-7532-4f3e-9bb2-4131a45bea8f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c372bb1-128f-4cbb-81df-21ff0252bb00]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:55:43 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:55:43 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:55:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:55:43 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:55:43 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:55:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7163432-5d73-44cb-940d-1a31349213f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9, portal: 172.16.0.220,3260]
Nov 16 00:55:43 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9, portal: 172.16.0.220,3260] successful.
Nov 16 00:55:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3911bd36-e19b-41ce-aa18-84878e653721]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bddcecf-9b54-40e3-8056-952899952cd0]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:55:43 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:55:43 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:55:43 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:55:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:55:43 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:55:43 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:55:43 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:55:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] HCTL ('35', '-', '-', 0) found on session 40 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8c4fe9-56dd-40e6-a564-37f8a539e516]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching for a device in session 40 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YfjsiECh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-04c49d66-81d2-4a73-9d6a-02581d59e3bf req-4899b684-712c-41e1-a29f-ee90bfd97e1d service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Received event network-vif-unplugged-63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-04c49d66-81d2-4a73-9d6a-02581d59e3bf req-4899b684-712c-41e1-a29f-ee90bfd97e1d service nova] Acquiring lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-04c49d66-81d2-4a73-9d6a-02581d59e3bf req-4899b684-712c-41e1-a29f-ee90bfd97e1d service nova] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-04c49d66-81d2-4a73-9d6a-02581d59e3bf req-4899b684-712c-41e1-a29f-ee90bfd97e1d service nova] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-04c49d66-81d2-4a73-9d6a-02581d59e3bf req-4899b684-712c-41e1-a29f-ee90bfd97e1d service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] No waiting events found dispatching network-vif-unplugged-63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.compute.manager [req-04c49d66-81d2-4a73-9d6a-02581d59e3bf req-4899b684-712c-41e1-a29f-ee90bfd97e1d service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Received event network-vif-unplugged-63798638-71ff-4e72-864c-d73d5e82104a for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:55:43 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Instance destroyed successfully.
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.objects.instance [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'resources' on Instance uuid 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:52:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-427846595',display_name='tempest-AttachVolumeNegativeTest-server-427846595',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-427846595',id=35,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDy/7NJ7NPA0fJz2VwnBgvS8lTjYgfm6AeLChHJZSB0wZ6QtVAZwLpNizluQyVEp9K4WkS0MG9EpQo3lX1ToHstoVHBolcaslar+eKS5nXZ0JFOrDJPaAHBLRp47HefK0g==',key_name='tempest-keypair-894041584',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:52:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13ad3ee3a8e04d728243e886a1460cae',ramdisk_id='',reservation_id='r-to5xmt03',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-471555798',owner_user_name='tempest-AttachVolumeNegativeTest-471555798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:52:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e2d1a7cea414446842b5abfc9fe93de',uuid=45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "63798638-71ff-4e72-864c-d73d5e82104a", "address": "fa:16:3e:5d:ba:e7", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63798638-71", "ovs_interfaceid": "63798638-71ff-4e72-864c-d73d5e82104a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converting VIF {"id": "63798638-71ff-4e72-864c-d73d5e82104a", "address": "fa:16:3e:5d:ba:e7", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap63798638-71", "ovs_interfaceid": "63798638-71ff-4e72-864c-d73d5e82104a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ba:e7,bridge_name='br-int',has_traffic_filtering=True,id=63798638-71ff-4e72-864c-d73d5e82104a,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63798638-71') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG os_vif [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ba:e7,bridge_name='br-int',has_traffic_filtering=True,id=63798638-71ff-4e72-864c-d73d5e82104a,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63798638-71') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap63798638-71, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c7f456e-bfda-4643-9167-cb02413dddb5) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:43 user nova-compute[75826]: INFO os_vif [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:ba:e7,bridge_name='br-int',has_traffic_filtering=True,id=63798638-71ff-4e72-864c-d73d5e82104a,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap63798638-71')
Nov 16 00:55:43 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Deleting instance files /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8_del
Nov 16 00:55:43 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Deletion of /opt/stack/data/nova/instances/45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8_del complete
Nov 16 00:55:43 user nova-compute[75826]: INFO nova.compute.manager [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 00:55:43 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:55:43 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23062646136316464', 'path': '/dev/sdd'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062646136316464', 'path': '/dev/sdd'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:55:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-817916153',display_name='tempest-TestVolumeBootPattern-volume-backed-server-817916153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-817916153',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsbSdXDHIqBFr67lLAupRb4mCxK8GoNRtHRTwLhubj0rip0gLpCVs47h62VSJwSTkVeXFahh1Jqx+yDWeipZOCbPrH2x5lr0Ok4LQEIDNpyd6SdlclD8E5WY57E4Nd3vA==',key_name='tempest-keypair-1836084774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-82mshcq5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:55:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c17265442bc48f9b6de5367e91096b2',uuid=24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "address": "fa:16:3e:f7:30:c4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bc56ab-de", "ovs_interfaceid": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "address": "fa:16:3e:f7:30:c4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bc56ab-de", "ovs_interfaceid": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=65bc56ab-de8e-44dc-938b-1bb5d84d7fcb,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bc56ab-de') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.objects.instance [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lazy-loading 'pci_devices' on Instance uuid 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:55:44 user nova-compute[75826]:   <uuid>24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a</uuid>
Nov 16 00:55:44 user nova-compute[75826]:   <name>instance-00000025</name>
Nov 16 00:55:44 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:55:44 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:55:44 user nova-compute[75826]:   <metadata>
Nov 16 00:55:44 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:55:44 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:55:44 user nova-compute[75826]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-817916153</nova:name>
Nov 16 00:55:44 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:55:43</nova:creationTime>
Nov 16 00:55:44 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:55:44 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:55:44 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:55:44 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:55:44 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:55:44 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:55:44 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:55:44 user nova-compute[75826]:       <nova:owner>
Nov 16 00:55:44 user nova-compute[75826]:         <nova:user uuid="6c17265442bc48f9b6de5367e91096b2">tempest-TestVolumeBootPattern-2108626012-project-member</nova:user>
Nov 16 00:55:44 user nova-compute[75826]:         <nova:project uuid="ef4135693756414fb70826b0f1d9345c">tempest-TestVolumeBootPattern-2108626012</nova:project>
Nov 16 00:55:44 user nova-compute[75826]:       </nova:owner>
Nov 16 00:55:44 user nova-compute[75826]:       <nova:ports>
Nov 16 00:55:44 user nova-compute[75826]:         <nova:port uuid="65bc56ab-de8e-44dc-938b-1bb5d84d7fcb">
Nov 16 00:55:44 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 16 00:55:44 user nova-compute[75826]:         </nova:port>
Nov 16 00:55:44 user nova-compute[75826]:       </nova:ports>
Nov 16 00:55:44 user nova-compute[75826]:     </nova:instance>
Nov 16 00:55:44 user nova-compute[75826]:   </metadata>
Nov 16 00:55:44 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:55:44 user nova-compute[75826]:     <system>
Nov 16 00:55:44 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:55:44 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:55:44 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:55:44 user nova-compute[75826]:       <entry name="serial">24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a</entry>
Nov 16 00:55:44 user nova-compute[75826]:       <entry name="uuid">24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a</entry>
Nov 16 00:55:44 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:55:44 user nova-compute[75826]:     </system>
Nov 16 00:55:44 user nova-compute[75826]:   </sysinfo>
Nov 16 00:55:44 user nova-compute[75826]:   <os>
Nov 16 00:55:44 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:55:44 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:55:44 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:55:44 user nova-compute[75826]:   </os>
Nov 16 00:55:44 user nova-compute[75826]:   <features>
Nov 16 00:55:44 user nova-compute[75826]:     <acpi/>
Nov 16 00:55:44 user nova-compute[75826]:     <apic/>
Nov 16 00:55:44 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:55:44 user nova-compute[75826]:   </features>
Nov 16 00:55:44 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:55:44 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:55:44 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:55:44 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:55:44 user nova-compute[75826]:   </clock>
Nov 16 00:55:44 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:55:44 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:55:44 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:55:44 user nova-compute[75826]:   </cpu>
Nov 16 00:55:44 user nova-compute[75826]:   <devices>
Nov 16 00:55:44 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:55:44 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:55:44 user nova-compute[75826]:       <source dev="/dev/sdd"/>
Nov 16 00:55:44 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:55:44 user nova-compute[75826]:       <serial>75914f2c-118c-4b41-93fb-79305d33dab9</serial>
Nov 16 00:55:44 user nova-compute[75826]:     </disk>
Nov 16 00:55:44 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:55:44 user nova-compute[75826]:       <mac address="fa:16:3e:f7:30:c4"/>
Nov 16 00:55:44 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:55:44 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:55:44 user nova-compute[75826]:       <target dev="tap65bc56ab-de"/>
Nov 16 00:55:44 user nova-compute[75826]:     </interface>
Nov 16 00:55:44 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:55:44 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a/console.log" append="off"/>
Nov 16 00:55:44 user nova-compute[75826]:     </serial>
Nov 16 00:55:44 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:55:44 user nova-compute[75826]:     <video>
Nov 16 00:55:44 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:55:44 user nova-compute[75826]:     </video>
Nov 16 00:55:44 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:55:44 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:55:44 user nova-compute[75826]:     </rng>
Nov 16 00:55:44 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:55:44 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:55:44 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:55:44 user nova-compute[75826]:     </memballoon>
Nov 16 00:55:44 user nova-compute[75826]:   </devices>
Nov 16 00:55:44 user nova-compute[75826]: </domain>
Nov 16 00:55:44 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:55:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-817916153',display_name='tempest-TestVolumeBootPattern-volume-backed-server-817916153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-817916153',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsbSdXDHIqBFr67lLAupRb4mCxK8GoNRtHRTwLhubj0rip0gLpCVs47h62VSJwSTkVeXFahh1Jqx+yDWeipZOCbPrH2x5lr0Ok4LQEIDNpyd6SdlclD8E5WY57E4Nd3vA==',key_name='tempest-keypair-1836084774',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-82mshcq5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:55:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c17265442bc48f9b6de5367e91096b2',uuid=24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "address": "fa:16:3e:f7:30:c4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bc56ab-de", "ovs_interfaceid": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "address": "fa:16:3e:f7:30:c4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bc56ab-de", "ovs_interfaceid": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=65bc56ab-de8e-44dc-938b-1bb5d84d7fcb,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bc56ab-de') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG os_vif [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=65bc56ab-de8e-44dc-938b-1bb5d84d7fcb,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bc56ab-de') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e191b23-504e-5331-93cb-789964ad1348', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap65bc56ab-de, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap65bc56ab-de, col_values=(('qos', UUID('443dec37-f816-49c5-b238-2beb4588506b')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap65bc56ab-de, col_values=(('external_ids', {'iface-id': '65bc56ab-de8e-44dc-938b-1bb5d84d7fcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:30:c4', 'vm-uuid': '24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:44 user nova-compute[75826]: INFO os_vif [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=65bc56ab-de8e-44dc-938b-1bb5d84d7fcb,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bc56ab-de')
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:55:44 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Took 0.68 seconds to deallocate network for instance.
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-d73f53b1-c7e3-476e-a7eb-96901904f770 req-145bcb98-a9f5-4d1a-99cd-8c3bfa5cb009 service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Received event network-vif-deleted-63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:55:44 user nova-compute[75826]: INFO nova.compute.manager [req-d73f53b1-c7e3-476e-a7eb-96901904f770 req-145bcb98-a9f5-4d1a-99cd-8c3bfa5cb009 service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Neutron deleted interface 63798638-71ff-4e72-864c-d73d5e82104a; detaching it from the instance and deleting it from the info cache
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-d73f53b1-c7e3-476e-a7eb-96901904f770 req-145bcb98-a9f5-4d1a-99cd-8c3bfa5cb009 service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-d73f53b1-c7e3-476e-a7eb-96901904f770 req-145bcb98-a9f5-4d1a-99cd-8c3bfa5cb009 service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Detach interface failed, port_id=63798638-71ff-4e72-864c-d73d5e82104a, reason: Instance 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8 could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] No VIF found with MAC fa:16:3e:f7:30:c4, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:55:44 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:55:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:45 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Deleted allocations for instance 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8
Nov 16 00:55:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-251bf905-5019-4991-9c1d-1f6d05f836d9 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.119s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:45 user nova-compute[75826]: DEBUG nova.compute.manager [req-21acada2-56c2-4fb3-8e7f-a2b80fad89e0 req-62e78ba3-2070-4f14-b183-289797596970 service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Received event network-vif-plugged-63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:55:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-21acada2-56c2-4fb3-8e7f-a2b80fad89e0 req-62e78ba3-2070-4f14-b183-289797596970 service nova] Acquiring lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-21acada2-56c2-4fb3-8e7f-a2b80fad89e0 req-62e78ba3-2070-4f14-b183-289797596970 service nova] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-21acada2-56c2-4fb3-8e7f-a2b80fad89e0 req-62e78ba3-2070-4f14-b183-289797596970 service nova] Lock "45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:45 user nova-compute[75826]: DEBUG nova.compute.manager [req-21acada2-56c2-4fb3-8e7f-a2b80fad89e0 req-62e78ba3-2070-4f14-b183-289797596970 service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] No waiting events found dispatching network-vif-plugged-63798638-71ff-4e72-864c-d73d5e82104a {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:55:45 user nova-compute[75826]: WARNING nova.compute.manager [req-21acada2-56c2-4fb3-8e7f-a2b80fad89e0 req-62e78ba3-2070-4f14-b183-289797596970 service nova] [instance: 45e5e2f7-c5c6-45a1-b32b-e61f53ddb6f8] Received unexpected event network-vif-plugged-63798638-71ff-4e72-864c-d73d5e82104a for instance with vm_state deleted and task_state None.
Nov 16 00:55:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-03aa30b8-eebb-4f17-acb6-3d88eeea61f5 req-3aa8cc9c-aa37-45d2-871b-09dde6447705 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received event network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:55:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-03aa30b8-eebb-4f17-acb6-3d88eeea61f5 req-3aa8cc9c-aa37-45d2-871b-09dde6447705 service nova] Acquiring lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-03aa30b8-eebb-4f17-acb6-3d88eeea61f5 req-3aa8cc9c-aa37-45d2-871b-09dde6447705 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-03aa30b8-eebb-4f17-acb6-3d88eeea61f5 req-3aa8cc9c-aa37-45d2-871b-09dde6447705 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-03aa30b8-eebb-4f17-acb6-3d88eeea61f5 req-3aa8cc9c-aa37-45d2-871b-09dde6447705 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] No waiting events found dispatching network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:55:46 user nova-compute[75826]: WARNING nova.compute.manager [req-03aa30b8-eebb-4f17-acb6-3d88eeea61f5 req-3aa8cc9c-aa37-45d2-871b-09dde6447705 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received unexpected event network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb for instance with vm_state building and task_state spawning.
Nov 16 00:55:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-03aa30b8-eebb-4f17-acb6-3d88eeea61f5 req-3aa8cc9c-aa37-45d2-871b-09dde6447705 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received event network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:55:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-03aa30b8-eebb-4f17-acb6-3d88eeea61f5 req-3aa8cc9c-aa37-45d2-871b-09dde6447705 service nova] Acquiring lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-03aa30b8-eebb-4f17-acb6-3d88eeea61f5 req-3aa8cc9c-aa37-45d2-871b-09dde6447705 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-03aa30b8-eebb-4f17-acb6-3d88eeea61f5 req-3aa8cc9c-aa37-45d2-871b-09dde6447705 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-03aa30b8-eebb-4f17-acb6-3d88eeea61f5 req-3aa8cc9c-aa37-45d2-871b-09dde6447705 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] No waiting events found dispatching network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:55:46 user nova-compute[75826]: WARNING nova.compute.manager [req-03aa30b8-eebb-4f17-acb6-3d88eeea61f5 req-3aa8cc9c-aa37-45d2-871b-09dde6447705 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received unexpected event network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb for instance with vm_state building and task_state spawning.
Nov 16 00:55:47 user nova-compute[75826]: DEBUG nova.compute.manager [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:55:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:55:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Instance spawned successfully.
Nov 16 00:55:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:55:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:55:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:55:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:55:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:55:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:55:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:55:48 user nova-compute[75826]: INFO nova.compute.manager [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 16 00:55:48 user nova-compute[75826]: DEBUG nova.compute.manager [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:55:48 user nova-compute[75826]: INFO nova.compute.manager [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Took 10.89 seconds to build instance.
Nov 16 00:55:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-95cc3c81-b566-4540-80c0-b68e7391a554 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.986s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-8025a104-7844-4139-a036-e9346a972394 req-b6c72bc5-c38a-4c7a-b26c-a8085d038d36 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Received event network-changed-835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:55:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-8025a104-7844-4139-a036-e9346a972394 req-b6c72bc5-c38a-4c7a-b26c-a8085d038d36 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Refreshing instance network info cache due to event network-changed-835bfef6-ab32-4a31-b7e2-3c189e15d489. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:55:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8025a104-7844-4139-a036-e9346a972394 req-b6c72bc5-c38a-4c7a-b26c-a8085d038d36 service nova] Acquiring lock "refresh_cache-bdd698af-6740-4dc2-8411-54ccb62a48a9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:55:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8025a104-7844-4139-a036-e9346a972394 req-b6c72bc5-c38a-4c7a-b26c-a8085d038d36 service nova] Acquired lock "refresh_cache-bdd698af-6740-4dc2-8411-54ccb62a48a9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:55:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-8025a104-7844-4139-a036-e9346a972394 req-b6c72bc5-c38a-4c7a-b26c-a8085d038d36 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Refreshing network info cache for port 835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:55:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-8025a104-7844-4139-a036-e9346a972394 req-b6c72bc5-c38a-4c7a-b26c-a8085d038d36 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Updated VIF entry in instance network info cache for port 835bfef6-ab32-4a31-b7e2-3c189e15d489. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:55:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-8025a104-7844-4139-a036-e9346a972394 req-b6c72bc5-c38a-4c7a-b26c-a8085d038d36 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Updating instance_info_cache with network_info: [{"id": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "address": "fa:16:3e:ee:89:64", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835bfef6-ab", "ovs_interfaceid": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:55:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8025a104-7844-4139-a036-e9346a972394 req-b6c72bc5-c38a-4c7a-b26c-a8085d038d36 service nova] Releasing lock "refresh_cache-bdd698af-6740-4dc2-8411-54ccb62a48a9" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:55:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:49 user nova-compute[75826]: DEBUG nova.objects.instance [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'flavor' on Instance uuid bdd698af-6740-4dc2-8411-54ccb62a48a9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:55:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:55:50 user nova-compute[75826]: INFO nova.compute.manager [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Attaching volume ce89ac30-782c-4fcc-8eeb-83e1cc3036fd to /dev/vdb
Nov 16 00:55:50 user nova-compute[75826]: DEBUG os_brick.utils [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[da35c3bf-dd5d-4bb9-9130-8904ba3bb0f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef2ee3c-e461-4e67-994f-75685ff5a7f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[97861c11-f9a7-456f-83c6-e9b84afd0e7a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fefb8a08-ff93-46b5-91be-a2bce1f4bc0a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:55:50 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:55:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fc4759-8767-46f2-a8b6-7a33bf0af5a3]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG os_brick.utils [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:55:50 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Updating existing volume attachment record: eb8310b2-25b0-436f-a0b0-022b31039268 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:55:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbXBOzJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:55:55 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:55:55 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:55:55 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d115de-bc7f-4d6a-ab12-6087e6e6b29f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:55:55 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac343de-9ec7-44cb-8285-779e4ebe42c8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd] added
Nov 16 00:55:55 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[64438639-c884-4fd6-bdea-8482ae49be0f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a482b8-04d5-4177-841a-ecbd04be3040]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jbXBOzJY {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jbXBOzJY" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb91f77-3edb-483f-a42c-ef6b5b7b91fc]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jbXBOzJY'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f81668-2e61-495c-82eb-eb7cf8048d91]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0508fe20-29cb-4a89-af27-146134467cb4]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:55:55 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:55:55 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b808e9cf-3f10-4a18-952f-106c16469482]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd, portal: 172.16.0.220,3260]
Nov 16 00:55:55 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd, portal: 172.16.0.220,3260] successful.
Nov 16 00:55:55 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1d86bc-c366-4706-93a4-e69b0e7104fd]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1228d7-27ca-4ba8-95e3-04c72f9a5190]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)
Nov 16 00:55:55 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:55:55 user nova-compute[75826]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)
Nov 16 00:55:55 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] HCTL ('36', '-', '-', 0) found on session 41 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d07272-7fb1-4c29-b27a-4f18c8fb13c6]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Searching for a device in session 41 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:55:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbXBOzJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:55:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:55:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '23738663961633133', 'path': '/dev/sde'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:55:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738663961633133', 'path': '/dev/sde'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:55:56 user nova-compute[75826]: DEBUG nova.objects.instance [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'flavor' on Instance uuid bdd698af-6740-4dc2-8411-54ccb62a48a9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:55:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:55:56 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:55:56 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 00:55:56 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:55:56 user nova-compute[75826]:   <serial>ce89ac30-782c-4fcc-8eeb-83e1cc3036fd</serial>
Nov 16 00:55:56 user nova-compute[75826]: </disk>
Nov 16 00:55:56 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:55:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:55:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:55:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No VIF found with MAC fa:16:3e:ee:89:64, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:55:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-b6fb2ffd-1fea-41bc-97cd-c80ecbfb8a99 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.235s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:55:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:55:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG nova.objects.instance [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'flavor' on Instance uuid bdd698af-6740-4dc2-8411-54ccb62a48a9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:00 user nova-compute[75826]: INFO nova.compute.manager [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Attaching volume 226a3d29-5050-4e11-9140-c28f20ee36ef to /dev/vdc
Nov 16 00:56:00 user nova-compute[75826]: DEBUG os_brick.utils [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d847882-fa6e-4fe3-aee9-5b978f477b60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc7c979-92c0-4c9e-a4a8-100587ab992e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff07fca4-5109-4fc3-8a18-9844999c52cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05ba604-7e05-489d-9b90-effd454e2cde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:56:00 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:56:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7c945b-4db2-4009-80c0-efd5c17fa70e]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG os_brick.utils [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:56:00 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Updating existing volume attachment record: 1bf23031-d015-4a35-9329-2498724201d0 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:56:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:05 user nova-compute[75826]: INFO nova.compute.manager [None req-eb100541-08a2-45e8-875f-46ed0e0c7014 tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Get console output
Nov 16 00:56:05 user nova-compute[75826]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 16 00:56:05 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdUygkxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:56:05 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:56:05 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:56:05 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[abde6bbb-9d9f-427c-972f-156eda9adec6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:56:05 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec286c0d-5dcd-470e-88c2-ccaea563ec9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef] added
Nov 16 00:56:05 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04e03c5-c36f-4619-8f4e-9094359e508a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae5df69-ae9a-4402-ace6-5f0db8ec1754]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sdUygkxS {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sdUygkxS" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2c39a2-9929-4afa-a878-fc92956a7530]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sdUygkxS'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8eae7da-94c7-4e34-8f8b-76223638fd4e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5a49fb-dabb-4b6f-a983-e2c37f362545]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:56:05 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:56:05 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:56:05 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:56:05 user nova-compute[75826]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)
Nov 16 00:56:05 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:56:05 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:56:05 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:56:05 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:56:05 user nova-compute[75826]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)
Nov 16 00:56:05 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0403833c-cf26-4492-8765-ccd4af19cb89]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef, portal: 172.16.0.220,3260]
Nov 16 00:56:05 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef, portal: 172.16.0.220,3260] successful.
Nov 16 00:56:05 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3eab92f6-8b5a-45ed-88a0-2db12bda078f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ea3591-d27f-4ab4-831b-0e73f5667e41]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:56:06 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:56:06 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:56:06 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:56:06 user nova-compute[75826]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)
Nov 16 00:56:06 user nova-compute[75826]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef (non-flash)
Nov 16 00:56:06 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:56:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:56:06 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:56:06 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:56:06 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:56:06 user nova-compute[75826]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)
Nov 16 00:56:06 user nova-compute[75826]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef (non-flash)
Nov 16 00:56:06 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:56:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:56:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:56:06 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] HCTL ('38', '-', '-', 0) found on session 42 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:56:06 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:56:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:06 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:56:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff56af9-92f1-4413-bda5-b376588edfe6]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:06 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:56:07 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Searching for a device in session 42 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:56:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdUygkxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:56:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:56:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26432643865313637', 'path': '/dev/sdg'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:56:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26432643865313637', 'path': '/dev/sdg'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:56:07 user nova-compute[75826]: DEBUG nova.objects.instance [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'flavor' on Instance uuid bdd698af-6740-4dc2-8411-54ccb62a48a9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:56:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:56:07 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:56:07 user nova-compute[75826]:   <source dev="/dev/sdg"/>
Nov 16 00:56:07 user nova-compute[75826]:   <target dev="vdc" bus="virtio"/>
Nov 16 00:56:07 user nova-compute[75826]:   <serial>226a3d29-5050-4e11-9140-c28f20ee36ef</serial>
Nov 16 00:56:07 user nova-compute[75826]: </disk>
Nov 16 00:56:07 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:56:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:56:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:56:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:56:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] No VIF found with MAC fa:16:3e:ee:89:64, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:56:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-566f8814-5cd3-4083-9856-bde67b2aa762 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.094s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:08 user nova-compute[75826]: INFO nova.compute.manager [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Detaching volume ce89ac30-782c-4fcc-8eeb-83e1cc3036fd
Nov 16 00:56:08 user nova-compute[75826]: INFO nova.virt.block_device [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Attempting to driver detach volume ce89ac30-782c-4fcc-8eeb-83e1cc3036fd from mountpoint /dev/vdb
Nov 16 00:56:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Attempting to detach device vdb from instance bdd698af-6740-4dc2-8411-54ccb62a48a9 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:56:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:56:08 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:56:08 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 00:56:08 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:56:08 user nova-compute[75826]:   <serial>ce89ac30-782c-4fcc-8eeb-83e1cc3036fd</serial>
Nov 16 00:56:08 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:56:08 user nova-compute[75826]: </disk>
Nov 16 00:56:08 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:56:08 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully detached device vdb from instance bdd698af-6740-4dc2-8411-54ccb62a48a9 from the persistent domain config.
Nov 16 00:56:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bdd698af-6740-4dc2-8411-54ccb62a48a9 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:56:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:56:08 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:56:08 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 00:56:08 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:56:08 user nova-compute[75826]:   <serial>ce89ac30-782c-4fcc-8eeb-83e1cc3036fd</serial>
Nov 16 00:56:08 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:56:08 user nova-compute[75826]: </disk>
Nov 16 00:56:08 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:56:09 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:56:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:56:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:56:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:56:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:56:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bdd698af-6740-4dc2-8411-54ccb62a48a9 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:56:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Updating instance_info_cache with network_info: [{"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:56:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:56:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:56:09 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:56:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.237s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "34bed458-5248-473d-b022-7f953669d85c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "34bed458-5248-473d-b022-7f953669d85c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "34bed458-5248-473d-b022-7f953669d85c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:12 user nova-compute[75826]: INFO nova.compute.manager [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Terminating instance
Nov 16 00:56:12 user nova-compute[75826]: DEBUG nova.compute.manager [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-008a7c87-c08c-431e-8894-1120c3b30c2b req-9b9ac422-e836-4102-b503-ddc712176242 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-unplugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-008a7c87-c08c-431e-8894-1120c3b30c2b req-9b9ac422-e836-4102-b503-ddc712176242 service nova] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-008a7c87-c08c-431e-8894-1120c3b30c2b req-9b9ac422-e836-4102-b503-ddc712176242 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-008a7c87-c08c-431e-8894-1120c3b30c2b req-9b9ac422-e836-4102-b503-ddc712176242 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-008a7c87-c08c-431e-8894-1120c3b30c2b req-9b9ac422-e836-4102-b503-ddc712176242 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] No waiting events found dispatching network-vif-unplugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-008a7c87-c08c-431e-8894-1120c3b30c2b req-9b9ac422-e836-4102-b503-ddc712176242 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-unplugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:13 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 34bed458-5248-473d-b022-7f953669d85c] Instance destroyed successfully.
Nov 16 00:56:13 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'resources' on Instance uuid 34bed458-5248-473d-b022-7f953669d85c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:50:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-576016767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-576016767',id=32,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:52:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-505msulp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:54:26Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=34bed458-5248-473d-b022-7f953669d85c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "address": "fa:16:3e:52:f8:ec", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapedccd7c6-eb", "ovs_interfaceid": "edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:f8:ec,bridge_name='br-int',has_traffic_filtering=True,id=edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedccd7c6-eb') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG os_vif [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:f8:ec,bridge_name='br-int',has_traffic_filtering=True,id=edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedccd7c6-eb') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapedccd7c6-eb, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=64242cc8-5940-422d-b7b4-2be09f782f58) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:56:13 user nova-compute[75826]: INFO os_vif [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:f8:ec,bridge_name='br-int',has_traffic_filtering=True,id=edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapedccd7c6-eb')
Nov 16 00:56:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EDYTPtyH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:56:13 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:56:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ae3717-65df-4cdd-b329-937f7c352859]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:56:13 user nova-compute[75826]: No targets found.
Nov 16 00:56:13 user nova-compute[75826]: iSNS:
Nov 16 00:56:13 user nova-compute[75826]: No targets found.
Nov 16 00:56:13 user nova-compute[75826]: STATIC:
Nov 16 00:56:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd
Nov 16 00:56:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc
Nov 16 00:56:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9
Nov 16 00:56:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef
Nov 16 00:56:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9
Nov 16 00:56:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:13 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:56:13 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:13 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:13 user nova-compute[75826]: FIRMWARE:
Nov 16 00:56:13 user nova-compute[75826]: No targets found.
Nov 16 00:56:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:56:13 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:56:13 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bfe37b-44d2-4819-ad6d-63bb24db0715]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.114s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[945dbf77-2a4e-40a4-8f85-5bd35ec64c68]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:56:13 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:56:13 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:56:13 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:56:13 user nova-compute[75826]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)
Nov 16 00:56:13 user nova-compute[75826]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef (non-flash)
Nov 16 00:56:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:56:13 user nova-compute[75826]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc (non-flash)
Nov 16 00:56:13 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:56:13 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:56:13 user nova-compute[75826]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)
Nov 16 00:56:13 user nova-compute[75826]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef (non-flash)
Nov 16 00:56:13 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd944f16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc'): ({'sdf'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Removing single pathed devices sdf {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[125787a4-333c-48e4-b90a-f8844ee306cd]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a17908f-4742-4d01-a61b-7d73ab92f163]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flushing IO for device /dev/sdf {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:14 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:56:14 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7680MB free_disk=25.118751525878906GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7dd387-bd24-4916-b573-a5a2488bc973]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.055s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[db483fb6-31db-435a-ba7a-6946b90bcdc4]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[720cf755-b731-4735-a1e8-3ed643afedb5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 87b2703e-0154-445e-b659-5f5cf1d9f8f4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance cc77d9aa-4052-40dd-9495-3a516d8f0793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 34bed458-5248-473d-b022-7f953669d85c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 38a96872-51b5-448d-83c8-f722520d128c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance bdd698af-6740-4dc2-8411-54ccb62a48a9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb763ef-051d-4ff1-9de1-af2d0453452d]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc, portal: 172.16.0.220,3260]
Nov 16 00:56:14 user nova-compute[75826]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc, portal: 172.16.0.220,3260] successful.
Nov 16 00:56:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8c80aed0-5e47-4143-8665-68f0fd5531bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9285782-e436-4bad-83ea-998caf2e34d8]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.867s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] <== disconnect_volume: return (868ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:56:14 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Deleting instance files /opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c_del
Nov 16 00:56:14 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Deletion of /opt/stack/data/nova/instances/34bed458-5248-473d-b022-7f953669d85c_del complete
Nov 16 00:56:14 user nova-compute[75826]: INFO nova.compute.manager [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Took 1.77 seconds to destroy the instance on the hypervisor.
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 34bed458-5248-473d-b022-7f953669d85c] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 34bed458-5248-473d-b022-7f953669d85c] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.485s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-84956755-e10d-4f13-ae26-d2dd836a1f06 req-fc4070e2-8f95-4e58-9b59-7d38445bdea3 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-84956755-e10d-4f13-ae26-d2dd836a1f06 req-fc4070e2-8f95-4e58-9b59-7d38445bdea3 service nova] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-84956755-e10d-4f13-ae26-d2dd836a1f06 req-fc4070e2-8f95-4e58-9b59-7d38445bdea3 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-84956755-e10d-4f13-ae26-d2dd836a1f06 req-fc4070e2-8f95-4e58-9b59-7d38445bdea3 service nova] Lock "34bed458-5248-473d-b022-7f953669d85c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-84956755-e10d-4f13-ae26-d2dd836a1f06 req-fc4070e2-8f95-4e58-9b59-7d38445bdea3 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] No waiting events found dispatching network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:56:14 user nova-compute[75826]: WARNING nova.compute.manager [req-84956755-e10d-4f13-ae26-d2dd836a1f06 req-fc4070e2-8f95-4e58-9b59-7d38445bdea3 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received unexpected event network-vif-plugged-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e for instance with vm_state active and task_state deleting.
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 34bed458-5248-473d-b022-7f953669d85c] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:56:15 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 34bed458-5248-473d-b022-7f953669d85c] Took 0.78 seconds to deallocate network for instance.
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.compute.manager [req-a10234c1-efce-4d2e-bf44-5babd4aa6cf3 req-faa40ea1-0bfe-4e9f-83d1-fdb3e56df191 service nova] [instance: 34bed458-5248-473d-b022-7f953669d85c] Received event network-vif-deleted-edccd7c6-eb6d-4b62-a3f0-e920e4a8a11e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:56:15 user nova-compute[75826]: WARNING nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] While synchronizing instance power states, found 11 instances in the database and 10 instances on the hypervisor.
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 13b9b8b9-6ab1-4a8a-853f-00769b543743 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 87b2703e-0154-445e-b659-5f5cf1d9f8f4 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 574817b0-a25c-4da1-9ce6-804008e8279c {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 7d7971e0-c96d-4690-8a14-033f6dd35776 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid cc77d9aa-4052-40dd-9495-3a516d8f0793 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 38a96872-51b5-448d-83c8-f722520d128c {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid bdd698af-6740-4dc2-8411-54ccb62a48a9 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 34bed458-5248-473d-b022-7f953669d85c {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "13b9b8b9-6ab1-4a8a-853f-00769b543743" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "574817b0-a25c-4da1-9ce6-804008e8279c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "7d7971e0-c96d-4690-8a14-033f6dd35776" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "cc77d9aa-4052-40dd-9495-3a516d8f0793" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "38a96872-51b5-448d-83c8-f722520d128c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "34bed458-5248-473d-b022-7f953669d85c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "574817b0-a25c-4da1-9ce6-804008e8279c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "38a96872-51b5-448d-83c8-f722520d128c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.100s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:15 user nova-compute[75826]: INFO nova.compute.manager [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 34bed458-5248-473d-b022-7f953669d85c] Took 0.81 seconds to detach 1 volumes for instance.
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:16 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:56:16 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:56:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.323s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:16 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Deleted allocations for instance 34bed458-5248-473d-b022-7f953669d85c
Nov 16 00:56:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e5a182ed-54a3-4c69-9fa8-2cf591cfe5e6 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "34bed458-5248-473d-b022-7f953669d85c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.894s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "34bed458-5248-473d-b022-7f953669d85c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.761s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:16 user nova-compute[75826]: INFO nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 34bed458-5248-473d-b022-7f953669d85c] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 16 00:56:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "34bed458-5248-473d-b022-7f953669d85c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:20 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:56:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "f2aeb101-4454-4a86-9e77-9426c732d526" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:56:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:27 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:56:27 user nova-compute[75826]: INFO nova.compute.claims [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Claim successful on node user
Nov 16 00:56:27 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:56:27 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:56:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:56:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:56:27 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:56:27 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:56:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG nova.policy [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '923da525ba264ea4bf770e3a66319655', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7dc71f0e2f439f9944bd7410db7e08', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:56:28 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Creating image(s)
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "/opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "/opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk 1073741824" returned: 0 in 0.061s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Successfully created port: 0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.192s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Cannot resize image /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Ensure instance console log exists: /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:29 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bdd698af-6740-4dc2-8411-54ccb62a48a9 is timed out.
Nov 16 00:56:29 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully detached device vdb from instance bdd698af-6740-4dc2-8411-54ccb62a48a9 from the live domain config.
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jbXBOzJY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:56:29 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2fb727-a017-435d-8dff-07a945c6a08f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:56:29 user nova-compute[75826]: No targets found.
Nov 16 00:56:29 user nova-compute[75826]: iSNS:
Nov 16 00:56:29 user nova-compute[75826]: No targets found.
Nov 16 00:56:29 user nova-compute[75826]: STATIC:
Nov 16 00:56:29 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd
Nov 16 00:56:29 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:29 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:29 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9
Nov 16 00:56:29 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:29 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:29 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef
Nov 16 00:56:29 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:29 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:29 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9
Nov 16 00:56:29 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:29 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:29 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:56:29 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:29 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:29 user nova-compute[75826]: FIRMWARE:
Nov 16 00:56:29 user nova-compute[75826]: No targets found.
Nov 16 00:56:29 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:56:29 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:56:29 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fc6570-07bc-4cc2-bbd3-175b0f2ce25d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[05771f2e-bb6b-4c1c-b353-876631014039]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:56:29 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:56:29 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:56:29 user nova-compute[75826]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)
Nov 16 00:56:29 user nova-compute[75826]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef (non-flash)
Nov 16 00:56:29 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:56:29 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:56:29 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:56:29 user nova-compute[75826]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd (non-flash)
Nov 16 00:56:29 user nova-compute[75826]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef (non-flash)
Nov 16 00:56:29 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb45bab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd'): ({'sde'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Removing single pathed devices sde {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Successfully updated port: 0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fc7d34-28b0-468d-9193-c159490ed9dc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquired lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[30972a39-5864-4e6e-ab49-242f853a1ee6]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Flushing IO for device /dev/sde {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4aa12c-f466-4c3f-8337-022efbc4a2e5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-2ca87821-fb9a-4411-a3b8-781abc80f715 req-e07a3cc2-acfc-4e9f-8e11-2f0926189192 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-changed-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-2ca87821-fb9a-4411-a3b8-781abc80f715 req-e07a3cc2-acfc-4e9f-8e11-2f0926189192 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Refreshing instance network info cache due to event network-changed-0a09127f-96b6-4230-b058-dc47030afba4. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2ca87821-fb9a-4411-a3b8-781abc80f715 req-e07a3cc2-acfc-4e9f-8e11-2f0926189192 service nova] Acquiring lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef6a86b-0809-4ff5-a892-b4157dd5b630]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[35309efc-739f-4ebf-8b8a-9da4342e46bc]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cfbfb87-9429-4c7f-892c-522a8e12fbb2]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd, portal: 172.16.0.220,3260]
Nov 16 00:56:29 user nova-compute[75826]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd, portal: 172.16.0.220,3260] successful.
Nov 16 00:56:29 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ce89ac30-782c-4fcc-8eeb-83e1cc3036fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5b31bf-2934-48c1-bc9f-69e3c3ab9601]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] <== disconnect_volume: return (344ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updating instance_info_cache with network_info: [{"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Releasing lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Instance network_info: |[{"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2ca87821-fb9a-4411-a3b8-781abc80f715 req-e07a3cc2-acfc-4e9f-8e11-2f0926189192 service nova] Acquired lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.network.neutron [req-2ca87821-fb9a-4411-a3b8-781abc80f715 req-e07a3cc2-acfc-4e9f-8e11-2f0926189192 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Refreshing network info cache for port 0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Start _get_guest_xml network_info=[{"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:56:29 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:56:29 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:56:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1931447064',display_name='tempest-ServerRescueNegativeTestJSON-server-1931447064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1931447064',id=38,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAO+/aGa62dNPp9RH1R0Wypc9oWDJDToML3kI4x93EPcAtp7goSZTYKzM033CrSv1/iYvpRWEbP4rq0A7+uF0ZZLsb5opD9GCBDwqEXAOlP/s/mAZ00KZ8rAG94DsUIVTw==',key_name='tempest-keypair-1369388165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c7dc71f0e2f439f9944bd7410db7e08',ramdisk_id='',reservation_id='r-oug3e018',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2102246851',owner_user_name='tempest-ServerRescueNegativeTestJSON-2102246851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:56:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='923da525ba264ea4bf770e3a66319655',uuid=f2aeb101-4454-4a86-9e77-9426c732d526,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converting VIF {"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e9:47,bridge_name='br-int',has_traffic_filtering=True,id=0a09127f-96b6-4230-b058-dc47030afba4,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a09127f-96') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'pci_devices' on Instance uuid f2aeb101-4454-4a86-9e77-9426c732d526 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:56:29 user nova-compute[75826]:   <uuid>f2aeb101-4454-4a86-9e77-9426c732d526</uuid>
Nov 16 00:56:29 user nova-compute[75826]:   <name>instance-00000026</name>
Nov 16 00:56:29 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:56:29 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:56:29 user nova-compute[75826]:   <metadata>
Nov 16 00:56:29 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:56:29 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:56:29 user nova-compute[75826]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1931447064</nova:name>
Nov 16 00:56:29 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:56:29</nova:creationTime>
Nov 16 00:56:29 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:56:29 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:56:29 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:56:29 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:56:29 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:56:29 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:56:29 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:56:29 user nova-compute[75826]:       <nova:owner>
Nov 16 00:56:29 user nova-compute[75826]:         <nova:user uuid="923da525ba264ea4bf770e3a66319655">tempest-ServerRescueNegativeTestJSON-2102246851-project-member</nova:user>
Nov 16 00:56:29 user nova-compute[75826]:         <nova:project uuid="5c7dc71f0e2f439f9944bd7410db7e08">tempest-ServerRescueNegativeTestJSON-2102246851</nova:project>
Nov 16 00:56:29 user nova-compute[75826]:       </nova:owner>
Nov 16 00:56:29 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:56:29 user nova-compute[75826]:       <nova:ports>
Nov 16 00:56:29 user nova-compute[75826]:         <nova:port uuid="0a09127f-96b6-4230-b058-dc47030afba4">
Nov 16 00:56:29 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 00:56:29 user nova-compute[75826]:         </nova:port>
Nov 16 00:56:29 user nova-compute[75826]:       </nova:ports>
Nov 16 00:56:29 user nova-compute[75826]:     </nova:instance>
Nov 16 00:56:29 user nova-compute[75826]:   </metadata>
Nov 16 00:56:29 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:56:29 user nova-compute[75826]:     <system>
Nov 16 00:56:29 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:56:29 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:56:29 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:56:29 user nova-compute[75826]:       <entry name="serial">f2aeb101-4454-4a86-9e77-9426c732d526</entry>
Nov 16 00:56:29 user nova-compute[75826]:       <entry name="uuid">f2aeb101-4454-4a86-9e77-9426c732d526</entry>
Nov 16 00:56:29 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:56:29 user nova-compute[75826]:     </system>
Nov 16 00:56:29 user nova-compute[75826]:   </sysinfo>
Nov 16 00:56:29 user nova-compute[75826]:   <os>
Nov 16 00:56:29 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:56:29 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:56:29 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:56:29 user nova-compute[75826]:   </os>
Nov 16 00:56:29 user nova-compute[75826]:   <features>
Nov 16 00:56:29 user nova-compute[75826]:     <acpi/>
Nov 16 00:56:29 user nova-compute[75826]:     <apic/>
Nov 16 00:56:29 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:56:29 user nova-compute[75826]:   </features>
Nov 16 00:56:29 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:56:29 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:56:29 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:56:29 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:56:29 user nova-compute[75826]:   </clock>
Nov 16 00:56:29 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:56:29 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:56:29 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:56:29 user nova-compute[75826]:   </cpu>
Nov 16 00:56:29 user nova-compute[75826]:   <devices>
Nov 16 00:56:29 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:56:29 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:56:29 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk"/>
Nov 16 00:56:29 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:56:29 user nova-compute[75826]:     </disk>
Nov 16 00:56:29 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:56:29 user nova-compute[75826]:       <mac address="fa:16:3e:b8:e9:47"/>
Nov 16 00:56:29 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:56:29 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:56:29 user nova-compute[75826]:       <target dev="tap0a09127f-96"/>
Nov 16 00:56:29 user nova-compute[75826]:     </interface>
Nov 16 00:56:29 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:56:29 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/console.log" append="off"/>
Nov 16 00:56:29 user nova-compute[75826]:     </serial>
Nov 16 00:56:29 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:56:29 user nova-compute[75826]:     <video>
Nov 16 00:56:29 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:56:29 user nova-compute[75826]:     </video>
Nov 16 00:56:29 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:56:29 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:56:29 user nova-compute[75826]:     </rng>
Nov 16 00:56:29 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:56:29 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:56:29 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:56:29 user nova-compute[75826]:     </memballoon>
Nov 16 00:56:29 user nova-compute[75826]:   </devices>
Nov 16 00:56:29 user nova-compute[75826]: </domain>
Nov 16 00:56:29 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:56:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1931447064',display_name='tempest-ServerRescueNegativeTestJSON-server-1931447064',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1931447064',id=38,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAO+/aGa62dNPp9RH1R0Wypc9oWDJDToML3kI4x93EPcAtp7goSZTYKzM033CrSv1/iYvpRWEbP4rq0A7+uF0ZZLsb5opD9GCBDwqEXAOlP/s/mAZ00KZ8rAG94DsUIVTw==',key_name='tempest-keypair-1369388165',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c7dc71f0e2f439f9944bd7410db7e08',ramdisk_id='',reservation_id='r-oug3e018',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-2102246851',owner_user_name='tempest-ServerRescueNegativeTestJSON-2102246851-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:56:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='923da525ba264ea4bf770e3a66319655',uuid=f2aeb101-4454-4a86-9e77-9426c732d526,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converting VIF {"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e9:47,bridge_name='br-int',has_traffic_filtering=True,id=0a09127f-96b6-4230-b058-dc47030afba4,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a09127f-96') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG os_vif [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e9:47,bridge_name='br-int',has_traffic_filtering=True,id=0a09127f-96b6-4230-b058-dc47030afba4,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a09127f-96') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c986976c-f794-5f7c-aa3f-4d003e4b1e4b', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a09127f-96, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a09127f-96, col_values=(('qos', UUID('dad6dcb8-efbf-40fa-94f1-4c2cd077c25f')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a09127f-96, col_values=(('external_ids', {'iface-id': '0a09127f-96b6-4230-b058-dc47030afba4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:e9:47', 'vm-uuid': 'f2aeb101-4454-4a86-9e77-9426c732d526'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:29 user nova-compute[75826]: INFO os_vif [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:e9:47,bridge_name='br-int',has_traffic_filtering=True,id=0a09127f-96b6-4230-b058-dc47030afba4,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a09127f-96')
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:56:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No VIF found with MAC fa:16:3e:b8:e9:47, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:56:30 user nova-compute[75826]: DEBUG nova.network.neutron [req-2ca87821-fb9a-4411-a3b8-781abc80f715 req-e07a3cc2-acfc-4e9f-8e11-2f0926189192 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updated VIF entry in instance network info cache for port 0a09127f-96b6-4230-b058-dc47030afba4. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:56:30 user nova-compute[75826]: DEBUG nova.network.neutron [req-2ca87821-fb9a-4411-a3b8-781abc80f715 req-e07a3cc2-acfc-4e9f-8e11-2f0926189192 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updating instance_info_cache with network_info: [{"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:56:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2ca87821-fb9a-4411-a3b8-781abc80f715 req-e07a3cc2-acfc-4e9f-8e11-2f0926189192 service nova] Releasing lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:56:30 user nova-compute[75826]: DEBUG nova.objects.instance [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'flavor' on Instance uuid bdd698af-6740-4dc2-8411-54ccb62a48a9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:56:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0cbc19cc-0fa1-455a-8fa0-c50b498a5ee2 tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.883s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.792s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:31 user nova-compute[75826]: INFO nova.compute.manager [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Detaching volume 226a3d29-5050-4e11-9140-c28f20ee36ef
Nov 16 00:56:31 user nova-compute[75826]: INFO nova.virt.block_device [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Attempting to driver detach volume 226a3d29-5050-4e11-9140-c28f20ee36ef from mountpoint /dev/vdc
Nov 16 00:56:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Attempting to detach device vdc from instance bdd698af-6740-4dc2-8411-54ccb62a48a9 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:56:31 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:56:31 user nova-compute[75826]:   <source dev="/dev/sdg"/>
Nov 16 00:56:31 user nova-compute[75826]:   <target dev="vdc" bus="virtio"/>
Nov 16 00:56:31 user nova-compute[75826]:   <serial>226a3d29-5050-4e11-9140-c28f20ee36ef</serial>
Nov 16 00:56:31 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 00:56:31 user nova-compute[75826]: </disk>
Nov 16 00:56:31 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:31 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully detached device vdc from instance bdd698af-6740-4dc2-8411-54ccb62a48a9 from the persistent domain config.
Nov 16 00:56:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance bdd698af-6740-4dc2-8411-54ccb62a48a9 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:56:31 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:56:31 user nova-compute[75826]:   <source dev="/dev/sdg"/>
Nov 16 00:56:31 user nova-compute[75826]:   <target dev="vdc" bus="virtio"/>
Nov 16 00:56:31 user nova-compute[75826]:   <serial>226a3d29-5050-4e11-9140-c28f20ee36ef</serial>
Nov 16 00:56:31 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 00:56:31 user nova-compute[75826]: </disk>
Nov 16 00:56:31 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-33ab197e-2e3e-4730-a441-4dc35105b710 req-32466e78-a25d-4b07-b8b3-613389b0efa5 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-33ab197e-2e3e-4730-a441-4dc35105b710 req-32466e78-a25d-4b07-b8b3-613389b0efa5 service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-33ab197e-2e3e-4730-a441-4dc35105b710 req-32466e78-a25d-4b07-b8b3-613389b0efa5 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-33ab197e-2e3e-4730-a441-4dc35105b710 req-32466e78-a25d-4b07-b8b3-613389b0efa5 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-33ab197e-2e3e-4730-a441-4dc35105b710 req-32466e78-a25d-4b07-b8b3-613389b0efa5 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:56:31 user nova-compute[75826]: WARNING nova.compute.manager [req-33ab197e-2e3e-4730-a441-4dc35105b710 req-32466e78-a25d-4b07-b8b3-613389b0efa5 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state building and task_state spawning.
Nov 16 00:56:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance bdd698af-6740-4dc2-8411-54ccb62a48a9 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:56:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-2b699cbf-6ffa-40a4-afb3-15e6295789e4 req-b0916bfd-bb8c-453c-b3a3-47adc0d8d031 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2b699cbf-6ffa-40a4-afb3-15e6295789e4 req-b0916bfd-bb8c-453c-b3a3-47adc0d8d031 service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2b699cbf-6ffa-40a4-afb3-15e6295789e4 req-b0916bfd-bb8c-453c-b3a3-47adc0d8d031 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2b699cbf-6ffa-40a4-afb3-15e6295789e4 req-b0916bfd-bb8c-453c-b3a3-47adc0d8d031 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-2b699cbf-6ffa-40a4-afb3-15e6295789e4 req-b0916bfd-bb8c-453c-b3a3-47adc0d8d031 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:56:33 user nova-compute[75826]: WARNING nova.compute.manager [req-2b699cbf-6ffa-40a4-afb3-15e6295789e4 req-b0916bfd-bb8c-453c-b3a3-47adc0d8d031 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state building and task_state spawning.
Nov 16 00:56:33 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:56:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:56:33 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Instance spawned successfully.
Nov 16 00:56:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:56:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:33 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:33 user nova-compute[75826]: INFO nova.compute.manager [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Took 5.88 seconds to spawn the instance on the hypervisor.
Nov 16 00:56:33 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:56:34 user nova-compute[75826]: INFO nova.compute.manager [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Took 6.70 seconds to build instance.
Nov 16 00:56:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4e394236-6c7d-4d51-ba89-c6a0e10a30d7 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "f2aeb101-4454-4a86-9e77-9426c732d526" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.797s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "da626640-fed0-4b78-a62b-4d946f9e64ea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:37 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:56:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:37 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:56:37 user nova-compute[75826]: INFO nova.compute.claims [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Claim successful on node user
Nov 16 00:56:38 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.486s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:56:38 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:56:38 user nova-compute[75826]: DEBUG nova.policy [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e2d1a7cea414446842b5abfc9fe93de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13ad3ee3a8e04d728243e886a1460cae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:56:38 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Creating image(s)
Nov 16 00:56:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "/opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "/opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "/opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.201s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Successfully created port: ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk 1073741824" returned: 0 in 0.076s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Checking if we can resize image /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Cannot resize image /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Ensure instance console log exists: /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Successfully updated port: ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "refresh_cache-da626640-fed0-4b78-a62b-4d946f9e64ea" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquired lock "refresh_cache-da626640-fed0-4b78-a62b-4d946f9e64ea" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-0257ffeb-0dcc-4735-bc60-cf6b4a6a39a0 req-8f91c033-2bbd-429f-ab2d-193566eac546 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Received event network-changed-ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-0257ffeb-0dcc-4735-bc60-cf6b4a6a39a0 req-8f91c033-2bbd-429f-ab2d-193566eac546 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Refreshing instance network info cache due to event network-changed-ca0853d2-3703-40f3-970e-b64dae00d399. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0257ffeb-0dcc-4735-bc60-cf6b4a6a39a0 req-8f91c033-2bbd-429f-ab2d-193566eac546 service nova] Acquiring lock "refresh_cache-da626640-fed0-4b78-a62b-4d946f9e64ea" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Updating instance_info_cache with network_info: [{"id": "ca0853d2-3703-40f3-970e-b64dae00d399", "address": "fa:16:3e:bd:42:d3", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0853d2-37", "ovs_interfaceid": "ca0853d2-3703-40f3-970e-b64dae00d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Releasing lock "refresh_cache-da626640-fed0-4b78-a62b-4d946f9e64ea" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Instance network_info: |[{"id": "ca0853d2-3703-40f3-970e-b64dae00d399", "address": "fa:16:3e:bd:42:d3", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0853d2-37", "ovs_interfaceid": "ca0853d2-3703-40f3-970e-b64dae00d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0257ffeb-0dcc-4735-bc60-cf6b4a6a39a0 req-8f91c033-2bbd-429f-ab2d-193566eac546 service nova] Acquired lock "refresh_cache-da626640-fed0-4b78-a62b-4d946f9e64ea" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.network.neutron [req-0257ffeb-0dcc-4735-bc60-cf6b4a6a39a0 req-8f91c033-2bbd-429f-ab2d-193566eac546 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Refreshing network info cache for port ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Start _get_guest_xml network_info=[{"id": "ca0853d2-3703-40f3-970e-b64dae00d399", "address": "fa:16:3e:bd:42:d3", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0853d2-37", "ovs_interfaceid": "ca0853d2-3703-40f3-970e-b64dae00d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:56:40 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:56:40 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-963837593',display_name='tempest-AttachVolumeNegativeTest-server-963837593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-963837593',id=39,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5WXmTqZV7QuDCW2C3ly/rXAB1Vk2gyF7B30BBmr66Ieq/Q9JBwHlcG4AzQRH8RZ0HXNF5dXnVonI2+HbwWixXegqEqAoPk95Bl9yaT6Ltqv7mUDBU+auL8NvSpKEdtvA==',key_name='tempest-keypair-744156524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ad3ee3a8e04d728243e886a1460cae',ramdisk_id='',reservation_id='r-szp0w7lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471555798',owner_user_name='tempest-AttachVolumeNegativeTest-471555798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e2d1a7cea414446842b5abfc9fe93de',uuid=da626640-fed0-4b78-a62b-4d946f9e64ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca0853d2-3703-40f3-970e-b64dae00d399", "address": "fa:16:3e:bd:42:d3", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0853d2-37", "ovs_interfaceid": "ca0853d2-3703-40f3-970e-b64dae00d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converting VIF {"id": "ca0853d2-3703-40f3-970e-b64dae00d399", "address": "fa:16:3e:bd:42:d3", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0853d2-37", "ovs_interfaceid": "ca0853d2-3703-40f3-970e-b64dae00d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:42:d3,bridge_name='br-int',has_traffic_filtering=True,id=ca0853d2-3703-40f3-970e-b64dae00d399,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0853d2-37') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'pci_devices' on Instance uuid da626640-fed0-4b78-a62b-4d946f9e64ea {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:56:40 user nova-compute[75826]:   <uuid>da626640-fed0-4b78-a62b-4d946f9e64ea</uuid>
Nov 16 00:56:40 user nova-compute[75826]:   <name>instance-00000027</name>
Nov 16 00:56:40 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:56:40 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:56:40 user nova-compute[75826]:   <metadata>
Nov 16 00:56:40 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:56:40 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:56:40 user nova-compute[75826]:       <nova:name>tempest-AttachVolumeNegativeTest-server-963837593</nova:name>
Nov 16 00:56:40 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:56:40</nova:creationTime>
Nov 16 00:56:40 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:56:40 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:56:40 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:56:40 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:56:40 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:56:40 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:56:40 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:56:40 user nova-compute[75826]:       <nova:owner>
Nov 16 00:56:40 user nova-compute[75826]:         <nova:user uuid="0e2d1a7cea414446842b5abfc9fe93de">tempest-AttachVolumeNegativeTest-471555798-project-member</nova:user>
Nov 16 00:56:40 user nova-compute[75826]:         <nova:project uuid="13ad3ee3a8e04d728243e886a1460cae">tempest-AttachVolumeNegativeTest-471555798</nova:project>
Nov 16 00:56:40 user nova-compute[75826]:       </nova:owner>
Nov 16 00:56:40 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:56:40 user nova-compute[75826]:       <nova:ports>
Nov 16 00:56:40 user nova-compute[75826]:         <nova:port uuid="ca0853d2-3703-40f3-970e-b64dae00d399">
Nov 16 00:56:40 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 16 00:56:40 user nova-compute[75826]:         </nova:port>
Nov 16 00:56:40 user nova-compute[75826]:       </nova:ports>
Nov 16 00:56:40 user nova-compute[75826]:     </nova:instance>
Nov 16 00:56:40 user nova-compute[75826]:   </metadata>
Nov 16 00:56:40 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:56:40 user nova-compute[75826]:     <system>
Nov 16 00:56:40 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:56:40 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:56:40 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:56:40 user nova-compute[75826]:       <entry name="serial">da626640-fed0-4b78-a62b-4d946f9e64ea</entry>
Nov 16 00:56:40 user nova-compute[75826]:       <entry name="uuid">da626640-fed0-4b78-a62b-4d946f9e64ea</entry>
Nov 16 00:56:40 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:56:40 user nova-compute[75826]:     </system>
Nov 16 00:56:40 user nova-compute[75826]:   </sysinfo>
Nov 16 00:56:40 user nova-compute[75826]:   <os>
Nov 16 00:56:40 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:56:40 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:56:40 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:56:40 user nova-compute[75826]:   </os>
Nov 16 00:56:40 user nova-compute[75826]:   <features>
Nov 16 00:56:40 user nova-compute[75826]:     <acpi/>
Nov 16 00:56:40 user nova-compute[75826]:     <apic/>
Nov 16 00:56:40 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:56:40 user nova-compute[75826]:   </features>
Nov 16 00:56:40 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:56:40 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:56:40 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:56:40 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:56:40 user nova-compute[75826]:   </clock>
Nov 16 00:56:40 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:56:40 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:56:40 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:56:40 user nova-compute[75826]:   </cpu>
Nov 16 00:56:40 user nova-compute[75826]:   <devices>
Nov 16 00:56:40 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:56:40 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:56:40 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk"/>
Nov 16 00:56:40 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:56:40 user nova-compute[75826]:     </disk>
Nov 16 00:56:40 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:56:40 user nova-compute[75826]:       <mac address="fa:16:3e:bd:42:d3"/>
Nov 16 00:56:40 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:56:40 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:56:40 user nova-compute[75826]:       <target dev="tapca0853d2-37"/>
Nov 16 00:56:40 user nova-compute[75826]:     </interface>
Nov 16 00:56:40 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:56:40 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/console.log" append="off"/>
Nov 16 00:56:40 user nova-compute[75826]:     </serial>
Nov 16 00:56:40 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:56:40 user nova-compute[75826]:     <video>
Nov 16 00:56:40 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:56:40 user nova-compute[75826]:     </video>
Nov 16 00:56:40 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:56:40 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:56:40 user nova-compute[75826]:     </rng>
Nov 16 00:56:40 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:56:40 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:56:40 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:56:40 user nova-compute[75826]:     </memballoon>
Nov 16 00:56:40 user nova-compute[75826]:   </devices>
Nov 16 00:56:40 user nova-compute[75826]: </domain>
Nov 16 00:56:40 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-963837593',display_name='tempest-AttachVolumeNegativeTest-server-963837593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-963837593',id=39,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5WXmTqZV7QuDCW2C3ly/rXAB1Vk2gyF7B30BBmr66Ieq/Q9JBwHlcG4AzQRH8RZ0HXNF5dXnVonI2+HbwWixXegqEqAoPk95Bl9yaT6Ltqv7mUDBU+auL8NvSpKEdtvA==',key_name='tempest-keypair-744156524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13ad3ee3a8e04d728243e886a1460cae',ramdisk_id='',reservation_id='r-szp0w7lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-471555798',owner_user_name='tempest-AttachVolumeNegativeTest-471555798-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:56:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e2d1a7cea414446842b5abfc9fe93de',uuid=da626640-fed0-4b78-a62b-4d946f9e64ea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca0853d2-3703-40f3-970e-b64dae00d399", "address": "fa:16:3e:bd:42:d3", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0853d2-37", "ovs_interfaceid": "ca0853d2-3703-40f3-970e-b64dae00d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converting VIF {"id": "ca0853d2-3703-40f3-970e-b64dae00d399", "address": "fa:16:3e:bd:42:d3", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0853d2-37", "ovs_interfaceid": "ca0853d2-3703-40f3-970e-b64dae00d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:42:d3,bridge_name='br-int',has_traffic_filtering=True,id=ca0853d2-3703-40f3-970e-b64dae00d399,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0853d2-37') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG os_vif [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:42:d3,bridge_name='br-int',has_traffic_filtering=True,id=ca0853d2-3703-40f3-970e-b64dae00d399,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0853d2-37') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a32e8129-8cd7-57aa-913e-53c601e60a78', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca0853d2-37, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca0853d2-37, col_values=(('qos', UUID('b5b3b71f-ec9f-481c-8552-b0028b66f6ba')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca0853d2-37, col_values=(('external_ids', {'iface-id': 'ca0853d2-3703-40f3-970e-b64dae00d399', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:42:d3', 'vm-uuid': 'da626640-fed0-4b78-a62b-4d946f9e64ea'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:40 user nova-compute[75826]: INFO os_vif [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:42:d3,bridge_name='br-int',has_traffic_filtering=True,id=ca0853d2-3703-40f3-970e-b64dae00d399,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0853d2-37')
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No VIF found with MAC fa:16:3e:bd:42:d3, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.network.neutron [req-0257ffeb-0dcc-4735-bc60-cf6b4a6a39a0 req-8f91c033-2bbd-429f-ab2d-193566eac546 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Updated VIF entry in instance network info cache for port ca0853d2-3703-40f3-970e-b64dae00d399. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG nova.network.neutron [req-0257ffeb-0dcc-4735-bc60-cf6b4a6a39a0 req-8f91c033-2bbd-429f-ab2d-193566eac546 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Updating instance_info_cache with network_info: [{"id": "ca0853d2-3703-40f3-970e-b64dae00d399", "address": "fa:16:3e:bd:42:d3", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0853d2-37", "ovs_interfaceid": "ca0853d2-3703-40f3-970e-b64dae00d399", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:56:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0257ffeb-0dcc-4735-bc60-cf6b4a6a39a0 req-8f91c033-2bbd-429f-ab2d-193566eac546 service nova] Releasing lock "refresh_cache-da626640-fed0-4b78-a62b-4d946f9e64ea" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:56:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-d59b6f87-8bcf-48ba-ad6e-9d78d96a1368 req-a52c8ed3-fe2b-48d1-bd4d-635929698f7b service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Received event network-vif-plugged-ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d59b6f87-8bcf-48ba-ad6e-9d78d96a1368 req-a52c8ed3-fe2b-48d1-bd4d-635929698f7b service nova] Acquiring lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d59b6f87-8bcf-48ba-ad6e-9d78d96a1368 req-a52c8ed3-fe2b-48d1-bd4d-635929698f7b service nova] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d59b6f87-8bcf-48ba-ad6e-9d78d96a1368 req-a52c8ed3-fe2b-48d1-bd4d-635929698f7b service nova] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-d59b6f87-8bcf-48ba-ad6e-9d78d96a1368 req-a52c8ed3-fe2b-48d1-bd4d-635929698f7b service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] No waiting events found dispatching network-vif-plugged-ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:56:42 user nova-compute[75826]: WARNING nova.compute.manager [req-d59b6f87-8bcf-48ba-ad6e-9d78d96a1368 req-a52c8ed3-fe2b-48d1-bd4d-635929698f7b service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Received unexpected event network-vif-plugged-ca0853d2-3703-40f3-970e-b64dae00d399 for instance with vm_state building and task_state spawning.
Nov 16 00:56:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:56:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:56:44 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Instance spawned successfully.
Nov 16 00:56:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:56:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:44 user nova-compute[75826]: INFO nova.compute.manager [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Took 5.38 seconds to spawn the instance on the hypervisor.
Nov 16 00:56:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:56:44 user nova-compute[75826]: INFO nova.compute.manager [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Took 6.28 seconds to build instance.
Nov 16 00:56:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4b81b4ee-e121-4add-8e16-d118c84391b3 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.439s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-b86d32b2-b93f-4a87-a40c-443a00e416f7 req-05e34ad6-7852-4a5b-89fa-2228a3d991af service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Received event network-vif-plugged-ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b86d32b2-b93f-4a87-a40c-443a00e416f7 req-05e34ad6-7852-4a5b-89fa-2228a3d991af service nova] Acquiring lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b86d32b2-b93f-4a87-a40c-443a00e416f7 req-05e34ad6-7852-4a5b-89fa-2228a3d991af service nova] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b86d32b2-b93f-4a87-a40c-443a00e416f7 req-05e34ad6-7852-4a5b-89fa-2228a3d991af service nova] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-b86d32b2-b93f-4a87-a40c-443a00e416f7 req-05e34ad6-7852-4a5b-89fa-2228a3d991af service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] No waiting events found dispatching network-vif-plugged-ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:56:44 user nova-compute[75826]: WARNING nova.compute.manager [req-b86d32b2-b93f-4a87-a40c-443a00e416f7 req-05e34ad6-7852-4a5b-89fa-2228a3d991af service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Received unexpected event network-vif-plugged-ca0853d2-3703-40f3-970e-b64dae00d399 for instance with vm_state active and task_state None.
Nov 16 00:56:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:56:49 user nova-compute[75826]: INFO nova.compute.claims [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Claim successful on node user
Nov 16 00:56:49 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:56:49 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:56:49 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG nova.policy [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64aa8a18510d4d56b341f56cf8d5d3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa5ce9593fc4a4ea55228dd113781f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:56:49 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Creating image(s)
Nov 16 00:56:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "/opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "/opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "/opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "b94fa784a58e64fc12d686ae0b100f6252ae9992" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "b94fa784a58e64fc12d686ae0b100f6252ae9992" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.004s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992.part --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992.part --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:50 user nova-compute[75826]: DEBUG nova.virt.images [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] de6c5cc5-005e-4fa8-9f5c-0acdff3eff50 was qcow2, converting to raw {{(pid=75826) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 00:56:50 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 00:56:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992.part /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992.converted {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992.part /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992.converted" returned: 0 in 0.296s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992.converted --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:50 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Successfully created port: 9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "b94fa784a58e64fc12d686ae0b100f6252ae9992" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.179s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992 --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992 --force-share --output=json" returned: 0 in 0.168s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "b94fa784a58e64fc12d686ae0b100f6252ae9992" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "b94fa784a58e64fc12d686ae0b100f6252ae9992" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992 --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992 --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992,backing_fmt=raw /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992,backing_fmt=raw /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk 1073741824" returned: 0 in 0.066s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "b94fa784a58e64fc12d686ae0b100f6252ae9992" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992 --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Successfully updated port: 9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992 --force-share --output=json" returned: 0 in 0.239s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquired lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-9824e15f-7bf2-41b9-a342-ab3d3e3a687d req-e795c1b0-e2f5-40a3-b04d-199a25ecec03 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-changed-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-9824e15f-7bf2-41b9-a342-ab3d3e3a687d req-e795c1b0-e2f5-40a3-b04d-199a25ecec03 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Refreshing instance network info cache due to event network-changed-9891b7e5-c4e1-4202-ad4d-adbb33abfac6. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9824e15f-7bf2-41b9-a342-ab3d3e3a687d req-e795c1b0-e2f5-40a3-b04d-199a25ecec03 service nova] Acquiring lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Cannot resize image /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Ensure instance console log exists: /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:51 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance bdd698af-6740-4dc2-8411-54ccb62a48a9 is timed out.
Nov 16 00:56:51 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully detached device vdc from instance bdd698af-6740-4dc2-8411-54ccb62a48a9 from the live domain config.
Nov 16 00:56:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sdUygkxS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:56:51 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:56:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[329442be-03c1-44a2-9c74-1899004d1aa6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:56:51 user nova-compute[75826]: No targets found.
Nov 16 00:56:51 user nova-compute[75826]: iSNS:
Nov 16 00:56:51 user nova-compute[75826]: No targets found.
Nov 16 00:56:51 user nova-compute[75826]: STATIC:
Nov 16 00:56:51 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9
Nov 16 00:56:51 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:51 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:51 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef
Nov 16 00:56:51 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:51 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:51 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9
Nov 16 00:56:51 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:51 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:51 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:56:51 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:56:51 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:56:51 user nova-compute[75826]: FIRMWARE:
Nov 16 00:56:51 user nova-compute[75826]: No targets found.
Nov 16 00:56:51 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:56:51 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:56:51 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:56:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ab3619-9a71-40ff-8306-64c36c25382f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cbd480-c251-4f56-9e20-aba18d371b43]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:56:52 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:56:52 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:56:52 user nova-compute[75826]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef (non-flash)
Nov 16 00:56:52 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:56:52 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:56:52 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:56:52 user nova-compute[75826]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef (non-flash)
Nov 16 00:56:52 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd944be9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef'): ({'sdg'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Removing single pathed devices sdg {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6118a9-8648-4850-97ad-a019bb758fc3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updating instance_info_cache with network_info: [{"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[410827a1-dc0b-46f1-9b01-9be3a3acdb6d]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Flushing IO for device /dev/sdg {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Releasing lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Instance network_info: |[{"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9824e15f-7bf2-41b9-a342-ab3d3e3a687d req-e795c1b0-e2f5-40a3-b04d-199a25ecec03 service nova] Acquired lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.network.neutron [req-9824e15f-7bf2-41b9-a342-ab3d3e3a687d req-e795c1b0-e2f5-40a3-b04d-199a25ecec03 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Refreshing network info cache for port 9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Start _get_guest_xml network_info=[{"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:56:46Z,direct_url=<?>,disk_format='qcow2',id=de6c5cc5-005e-4fa8-9f5c-0acdff3eff50,min_disk=0,min_ram=0,name='tempest-scenario-img--1971956488',owner='9fa5ce9593fc4a4ea55228dd113781f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:56:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': 'de6c5cc5-005e-4fa8-9f5c-0acdff3eff50'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d10c8e06-3c56-4c4d-b14c-9c6468365c01]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:52 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:56:52 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:56:46Z,direct_url=<?>,disk_format='qcow2',id=de6c5cc5-005e-4fa8-9f5c-0acdff3eff50,min_disk=0,min_ram=0,name='tempest-scenario-img--1971956488',owner='9fa5ce9593fc4a4ea55228dd113781f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:56:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1390751704',display_name='tempest-TestMinimumBasicScenario-server-1390751704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1390751704',id=40,image_ref='de6c5cc5-005e-4fa8-9f5c-0acdff3eff50',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATszQpf97mXvPlPMw/Rcc7WhBJ8KfZflmFA/U/Qg15g3XxUIQBYedZJpwanKi7hNjXnDRb2dFKDFdA95Wcw9faV3VBX1hlc/s/P57pKnmvXD8ZiGwotD10hBdKtZrIgcw==',key_name='tempest-TestMinimumBasicScenario-1740530434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fa5ce9593fc4a4ea55228dd113781f1',ramdisk_id='',reservation_id='r-2e83hvx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='de6c5cc5-005e-4fa8-9f5c-0acdff3eff50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1996581904',owner_user_name='tempest-TestMinimumBasicScenario-1996581904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:56:50Z,user_data=None,user_id='64aa8a18510d4d56b341f56cf8d5d3dd',uuid=9fe77732-86b7-4e9e-ac07-0eef8f9d1405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converting VIF {"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.objects.instance [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.036s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eedb505-a938-479a-a1ad-b18a1d33bae7]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] SCSI volumes sdg have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:56:52 user nova-compute[75826]:   <uuid>9fe77732-86b7-4e9e-ac07-0eef8f9d1405</uuid>
Nov 16 00:56:52 user nova-compute[75826]:   <name>instance-00000028</name>
Nov 16 00:56:52 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:56:52 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:56:52 user nova-compute[75826]:   <metadata>
Nov 16 00:56:52 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:56:52 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:56:52 user nova-compute[75826]:       <nova:name>tempest-TestMinimumBasicScenario-server-1390751704</nova:name>
Nov 16 00:56:52 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:56:52</nova:creationTime>
Nov 16 00:56:52 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:56:52 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:56:52 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:56:52 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:56:52 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:56:52 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:56:52 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:56:52 user nova-compute[75826]:       <nova:owner>
Nov 16 00:56:52 user nova-compute[75826]:         <nova:user uuid="64aa8a18510d4d56b341f56cf8d5d3dd">tempest-TestMinimumBasicScenario-1996581904-project-member</nova:user>
Nov 16 00:56:52 user nova-compute[75826]:         <nova:project uuid="9fa5ce9593fc4a4ea55228dd113781f1">tempest-TestMinimumBasicScenario-1996581904</nova:project>
Nov 16 00:56:52 user nova-compute[75826]:       </nova:owner>
Nov 16 00:56:52 user nova-compute[75826]:       <nova:root type="image" uuid="de6c5cc5-005e-4fa8-9f5c-0acdff3eff50"/>
Nov 16 00:56:52 user nova-compute[75826]:       <nova:ports>
Nov 16 00:56:52 user nova-compute[75826]:         <nova:port uuid="9891b7e5-c4e1-4202-ad4d-adbb33abfac6">
Nov 16 00:56:52 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 00:56:52 user nova-compute[75826]:         </nova:port>
Nov 16 00:56:52 user nova-compute[75826]:       </nova:ports>
Nov 16 00:56:52 user nova-compute[75826]:     </nova:instance>
Nov 16 00:56:52 user nova-compute[75826]:   </metadata>
Nov 16 00:56:52 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:56:52 user nova-compute[75826]:     <system>
Nov 16 00:56:52 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:56:52 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:56:52 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:56:52 user nova-compute[75826]:       <entry name="serial">9fe77732-86b7-4e9e-ac07-0eef8f9d1405</entry>
Nov 16 00:56:52 user nova-compute[75826]:       <entry name="uuid">9fe77732-86b7-4e9e-ac07-0eef8f9d1405</entry>
Nov 16 00:56:52 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:56:52 user nova-compute[75826]:     </system>
Nov 16 00:56:52 user nova-compute[75826]:   </sysinfo>
Nov 16 00:56:52 user nova-compute[75826]:   <os>
Nov 16 00:56:52 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:56:52 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:56:52 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:56:52 user nova-compute[75826]:   </os>
Nov 16 00:56:52 user nova-compute[75826]:   <features>
Nov 16 00:56:52 user nova-compute[75826]:     <acpi/>
Nov 16 00:56:52 user nova-compute[75826]:     <apic/>
Nov 16 00:56:52 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:56:52 user nova-compute[75826]:   </features>
Nov 16 00:56:52 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:56:52 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:56:52 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:56:52 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:56:52 user nova-compute[75826]:   </clock>
Nov 16 00:56:52 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:56:52 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:56:52 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:56:52 user nova-compute[75826]:   </cpu>
Nov 16 00:56:52 user nova-compute[75826]:   <devices>
Nov 16 00:56:52 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:56:52 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:56:52 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk"/>
Nov 16 00:56:52 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:56:52 user nova-compute[75826]:     </disk>
Nov 16 00:56:52 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:56:52 user nova-compute[75826]:       <mac address="fa:16:3e:3b:01:ba"/>
Nov 16 00:56:52 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:56:52 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:56:52 user nova-compute[75826]:       <target dev="tap9891b7e5-c4"/>
Nov 16 00:56:52 user nova-compute[75826]:     </interface>
Nov 16 00:56:52 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:56:52 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/console.log" append="off"/>
Nov 16 00:56:52 user nova-compute[75826]:     </serial>
Nov 16 00:56:52 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:56:52 user nova-compute[75826]:     <video>
Nov 16 00:56:52 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:56:52 user nova-compute[75826]:     </video>
Nov 16 00:56:52 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:56:52 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:56:52 user nova-compute[75826]:     </rng>
Nov 16 00:56:52 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:56:52 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:56:52 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:56:52 user nova-compute[75826]:     </memballoon>
Nov 16 00:56:52 user nova-compute[75826]:   </devices>
Nov 16 00:56:52 user nova-compute[75826]: </domain>
Nov 16 00:56:52 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1390751704',display_name='tempest-TestMinimumBasicScenario-server-1390751704',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1390751704',id=40,image_ref='de6c5cc5-005e-4fa8-9f5c-0acdff3eff50',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATszQpf97mXvPlPMw/Rcc7WhBJ8KfZflmFA/U/Qg15g3XxUIQBYedZJpwanKi7hNjXnDRb2dFKDFdA95Wcw9faV3VBX1hlc/s/P57pKnmvXD8ZiGwotD10hBdKtZrIgcw==',key_name='tempest-TestMinimumBasicScenario-1740530434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fa5ce9593fc4a4ea55228dd113781f1',ramdisk_id='',reservation_id='r-2e83hvx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='de6c5cc5-005e-4fa8-9f5c-0acdff3eff50',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1996581904',owner_user_name='tempest-TestMinimumBasicScenario-1996581904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:56:50Z,user_data=None,user_id='64aa8a18510d4d56b341f56cf8d5d3dd',uuid=9fe77732-86b7-4e9e-ac07-0eef8f9d1405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converting VIF {"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_vif [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b840eda4-d749-5c0a-b71a-46cbbbcba13e', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9891b7e5-c4, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9891b7e5-c4, col_values=(('qos', UUID('277a9d7e-fa55-44fc-bbbb-ba8d4b9c9894')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9891b7e5-c4, col_values=(('external_ids', {'iface-id': '9891b7e5-c4e1-4202-ad4d-adbb33abfac6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:01:ba', 'vm-uuid': '9fe77732-86b7-4e9e-ac07-0eef8f9d1405'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6cc15c-b3d9-4525-abd2-a93b258ed30b]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:52 user nova-compute[75826]: INFO os_vif [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4')
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d180063-4965-4707-9c2f-5782d6de5240]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef, portal: 172.16.0.220,3260]
Nov 16 00:56:52 user nova-compute[75826]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef, portal: 172.16.0.220,3260] successful.
Nov 16 00:56:52 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] No VIF found with MAC fa:16:3e:3b:01:ba, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:226a3d29-5050-4e11-9140-c28f20ee36ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf1cd23-bd75-45c7-82ca-2f1e7f0030fa]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.381s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] <== disconnect_volume: return (383ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.network.neutron [req-9824e15f-7bf2-41b9-a342-ab3d3e3a687d req-e795c1b0-e2f5-40a3-b04d-199a25ecec03 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updated VIF entry in instance network info cache for port 9891b7e5-c4e1-4202-ad4d-adbb33abfac6. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG nova.network.neutron [req-9824e15f-7bf2-41b9-a342-ab3d3e3a687d req-e795c1b0-e2f5-40a3-b04d-199a25ecec03 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updating instance_info_cache with network_info: [{"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:56:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9824e15f-7bf2-41b9-a342-ab3d3e3a687d req-e795c1b0-e2f5-40a3-b04d-199a25ecec03 service nova] Releasing lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:56:53 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'flavor' on Instance uuid bdd698af-6740-4dc2-8411-54ccb62a48a9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:56:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c1009085-b7d2-46ed-9488-331f05bf868b tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.975s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-cede1922-78d2-42cb-9e03-dbde224e9e65 req-2a5f314e-a2ba-487c-8474-39464e553342 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-cede1922-78d2-42cb-9e03-dbde224e9e65 req-2a5f314e-a2ba-487c-8474-39464e553342 service nova] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-cede1922-78d2-42cb-9e03-dbde224e9e65 req-2a5f314e-a2ba-487c-8474-39464e553342 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-cede1922-78d2-42cb-9e03-dbde224e9e65 req-2a5f314e-a2ba-487c-8474-39464e553342 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-cede1922-78d2-42cb-9e03-dbde224e9e65 req-2a5f314e-a2ba-487c-8474-39464e553342 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] No waiting events found dispatching network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:56:54 user nova-compute[75826]: WARNING nova.compute.manager [req-cede1922-78d2-42cb-9e03-dbde224e9e65 req-2a5f314e-a2ba-487c-8474-39464e553342 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received unexpected event network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 for instance with vm_state building and task_state spawning.
Nov 16 00:56:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:54 user nova-compute[75826]: INFO nova.compute.manager [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Terminating instance
Nov 16 00:56:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-a63543af-858e-403c-8480-e5fbd37c4bcd req-473731dc-23fe-4c4a-bbd5-186215349353 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Received event network-vif-unplugged-835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a63543af-858e-403c-8480-e5fbd37c4bcd req-473731dc-23fe-4c4a-bbd5-186215349353 service nova] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a63543af-858e-403c-8480-e5fbd37c4bcd req-473731dc-23fe-4c4a-bbd5-186215349353 service nova] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a63543af-858e-403c-8480-e5fbd37c4bcd req-473731dc-23fe-4c4a-bbd5-186215349353 service nova] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-a63543af-858e-403c-8480-e5fbd37c4bcd req-473731dc-23fe-4c4a-bbd5-186215349353 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] No waiting events found dispatching network-vif-unplugged-835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:56:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-a63543af-858e-403c-8480-e5fbd37c4bcd req-473731dc-23fe-4c4a-bbd5-186215349353 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Received event network-vif-unplugged-835bfef6-ab32-4a31-b7e2-3c189e15d489 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:56:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Instance destroyed successfully.
Nov 16 00:56:55 user nova-compute[75826]: DEBUG nova.objects.instance [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lazy-loading 'resources' on Instance uuid bdd698af-6740-4dc2-8411-54ccb62a48a9 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:56:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:53:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1713999345',display_name='tempest-AttachVolumeTestJSON-server-1713999345',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1713999345',id=36,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCeoBt67AqiEq2qRF8NLARpnjmNcoRaAiYJKRAng0U0fbJ07DiPlER8YIajLTs/sqe+gVcL9xY+4qaDzdHXH+RrZ7Y0BN20FLhE5xqPj67NfW/5RqW/gZfl7QHMb8sVU0w==',key_name='tempest-keypair-1598111726',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:54:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='aa522b01f20c4d90bc4178e688319e7f',ramdisk_id='',reservation_id='r-hvio6q2v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1305137356',owner_user_name='tempest-AttachVolumeTestJSON-1305137356-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:54:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96797fc178ed4c2190f7a760b3bd30bd',uuid=bdd698af-6740-4dc2-8411-54ccb62a48a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "address": "fa:16:3e:ee:89:64", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835bfef6-ab", "ovs_interfaceid": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:56:55 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converting VIF {"id": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "address": "fa:16:3e:ee:89:64", "network": {"id": "cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1791202610-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "aa522b01f20c4d90bc4178e688319e7f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap835bfef6-ab", "ovs_interfaceid": "835bfef6-ab32-4a31-b7e2-3c189e15d489", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:56:55 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ee:89:64,bridge_name='br-int',has_traffic_filtering=True,id=835bfef6-ab32-4a31-b7e2-3c189e15d489,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835bfef6-ab') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:56:55 user nova-compute[75826]: DEBUG os_vif [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:89:64,bridge_name='br-int',has_traffic_filtering=True,id=835bfef6-ab32-4a31-b7e2-3c189e15d489,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835bfef6-ab') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:56:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap835bfef6-ab, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb872514-68af-40f3-b52d-1b6555405607) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:56:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:56:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:56:55 user nova-compute[75826]: INFO os_vif [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ee:89:64,bridge_name='br-int',has_traffic_filtering=True,id=835bfef6-ab32-4a31-b7e2-3c189e15d489,network=Network(cf9cdc7a-81fc-4b72-94c9-ce05d3004ba4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap835bfef6-ab')
Nov 16 00:56:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Deleting instance files /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9_del
Nov 16 00:56:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Deletion of /opt/stack/data/nova/instances/bdd698af-6740-4dc2-8411-54ccb62a48a9_del complete
Nov 16 00:56:55 user nova-compute[75826]: INFO nova.compute.manager [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 00:56:55 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:56:55 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:56:55 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:56:56 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Instance spawned successfully.
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-bfff1d4b-3c03-4be5-b049-e7f241d3ee46 req-c3f4027f-c77d-4828-b7ae-9609502bd3f0 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bfff1d4b-3c03-4be5-b049-e7f241d3ee46 req-c3f4027f-c77d-4828-b7ae-9609502bd3f0 service nova] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bfff1d4b-3c03-4be5-b049-e7f241d3ee46 req-c3f4027f-c77d-4828-b7ae-9609502bd3f0 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bfff1d4b-3c03-4be5-b049-e7f241d3ee46 req-c3f4027f-c77d-4828-b7ae-9609502bd3f0 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-bfff1d4b-3c03-4be5-b049-e7f241d3ee46 req-c3f4027f-c77d-4828-b7ae-9609502bd3f0 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] No waiting events found dispatching network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:56:56 user nova-compute[75826]: WARNING nova.compute.manager [req-bfff1d4b-3c03-4be5-b049-e7f241d3ee46 req-c3f4027f-c77d-4828-b7ae-9609502bd3f0 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received unexpected event network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 for instance with vm_state building and task_state spawning.
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:56:56 user nova-compute[75826]: INFO nova.compute.manager [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Took 6.34 seconds to spawn the instance on the hypervisor.
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:56:56 user nova-compute[75826]: INFO nova.compute.manager [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Took 7.16 seconds to build instance.
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3983e7a3-40b3-4559-ab64-ade27b597c28 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.263s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:56 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Took 0.91 seconds to deallocate network for instance.
Nov 16 00:56:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-a69f3fdc-5cba-4cac-ab6b-0d17b5c35110 req-d6af4e1f-7721-4431-aa83-f635b4e92e67 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Received event network-vif-plugged-835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a69f3fdc-5cba-4cac-ab6b-0d17b5c35110 req-d6af4e1f-7721-4431-aa83-f635b4e92e67 service nova] Acquiring lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a69f3fdc-5cba-4cac-ab6b-0d17b5c35110 req-d6af4e1f-7721-4431-aa83-f635b4e92e67 service nova] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a69f3fdc-5cba-4cac-ab6b-0d17b5c35110 req-d6af4e1f-7721-4431-aa83-f635b4e92e67 service nova] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-a69f3fdc-5cba-4cac-ab6b-0d17b5c35110 req-d6af4e1f-7721-4431-aa83-f635b4e92e67 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] No waiting events found dispatching network-vif-plugged-835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:56:56 user nova-compute[75826]: WARNING nova.compute.manager [req-a69f3fdc-5cba-4cac-ab6b-0d17b5c35110 req-d6af4e1f-7721-4431-aa83-f635b4e92e67 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Received unexpected event network-vif-plugged-835bfef6-ab32-4a31-b7e2-3c189e15d489 for instance with vm_state deleted and task_state None.
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:56:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:56 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Deleted allocations for instance bdd698af-6740-4dc2-8411-54ccb62a48a9
Nov 16 00:56:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ea7f9b91-a332-45f5-a913-65ecb2c759fb tempest-AttachVolumeTestJSON-1305137356 tempest-AttachVolumeTestJSON-1305137356-project-member] Lock "bdd698af-6740-4dc2-8411-54ccb62a48a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.537s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:56:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-e9920ce9-7ea6-4c45-9b0c-e2e6cf536e9d req-ea0f46ec-d223-40e8-9bc3-63bd8d65c596 service nova] [instance: bdd698af-6740-4dc2-8411-54ccb62a48a9] Received event network-vif-deleted-835bfef6-ab32-4a31-b7e2-3c189e15d489 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:56:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:03 user nova-compute[75826]: INFO nova.compute.manager [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Terminating instance
Nov 16 00:57:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-a1b0a603-93c1-4946-8106-486f96a12b02 req-9e19f47f-1b7d-43e4-b5d0-10764daf3c34 service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Received event network-vif-unplugged-80c45b41-fa0d-48f6-8006-367e6c52e6d1 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a1b0a603-93c1-4946-8106-486f96a12b02 req-9e19f47f-1b7d-43e4-b5d0-10764daf3c34 service nova] Acquiring lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a1b0a603-93c1-4946-8106-486f96a12b02 req-9e19f47f-1b7d-43e4-b5d0-10764daf3c34 service nova] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a1b0a603-93c1-4946-8106-486f96a12b02 req-9e19f47f-1b7d-43e4-b5d0-10764daf3c34 service nova] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-a1b0a603-93c1-4946-8106-486f96a12b02 req-9e19f47f-1b7d-43e4-b5d0-10764daf3c34 service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] No waiting events found dispatching network-vif-unplugged-80c45b41-fa0d-48f6-8006-367e6c52e6d1 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-a1b0a603-93c1-4946-8106-486f96a12b02 req-9e19f47f-1b7d-43e4-b5d0-10764daf3c34 service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Received event network-vif-unplugged-80c45b41-fa0d-48f6-8006-367e6c52e6d1 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:03 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Instance destroyed successfully.
Nov 16 00:57:03 user nova-compute[75826]: DEBUG nova.objects.instance [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'resources' on Instance uuid 87b2703e-0154-445e-b659-5f5cf1d9f8f4 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:47:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-597028634',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-597028634',id=24,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:47:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-b56xfuh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:49:36Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=87b2703e-0154-445e-b659-5f5cf1d9f8f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "address": "fa:16:3e:96:e6:37", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c45b41-fa", "ovs_interfaceid": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "address": "fa:16:3e:96:e6:37", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80c45b41-fa", "ovs_interfaceid": "80c45b41-fa0d-48f6-8006-367e6c52e6d1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=80c45b41-fa0d-48f6-8006-367e6c52e6d1,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c45b41-fa') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG os_vif [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=80c45b41-fa0d-48f6-8006-367e6c52e6d1,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c45b41-fa') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80c45b41-fa, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80cba40a-4c0a-42ef-b561-774a81e68768) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:57:03 user nova-compute[75826]: INFO os_vif [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:e6:37,bridge_name='br-int',has_traffic_filtering=True,id=80c45b41-fa0d-48f6-8006-367e6c52e6d1,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80c45b41-fa')
Nov 16 00:57:03 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Deleting instance files /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4_del
Nov 16 00:57:03 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Deletion of /opt/stack/data/nova/instances/87b2703e-0154-445e-b659-5f5cf1d9f8f4_del complete
Nov 16 00:57:03 user nova-compute[75826]: INFO nova.compute.manager [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 16 00:57:03 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:57:03 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:57:04 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:57:04 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Took 0.37 seconds to deallocate network for instance.
Nov 16 00:57:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-ceb443ea-eaf3-47ef-83d1-45948ae83c8c req-ccb71bdf-1855-4efd-9a66-9cd37a4b0f7d service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Received event network-vif-deleted-80c45b41-fa0d-48f6-8006-367e6c52e6d1 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:04 user nova-compute[75826]: INFO nova.compute.manager [req-ceb443ea-eaf3-47ef-83d1-45948ae83c8c req-ccb71bdf-1855-4efd-9a66-9cd37a4b0f7d service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Neutron deleted interface 80c45b41-fa0d-48f6-8006-367e6c52e6d1; detaching it from the instance and deleting it from the info cache
Nov 16 00:57:04 user nova-compute[75826]: DEBUG nova.network.neutron [req-ceb443ea-eaf3-47ef-83d1-45948ae83c8c req-ccb71bdf-1855-4efd-9a66-9cd37a4b0f7d service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:57:04 user nova-compute[75826]: DEBUG nova.compute.manager [req-ceb443ea-eaf3-47ef-83d1-45948ae83c8c req-ccb71bdf-1855-4efd-9a66-9cd37a4b0f7d service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Detach interface failed, port_id=80c45b41-fa0d-48f6-8006-367e6c52e6d1, reason: Instance 87b2703e-0154-445e-b659-5f5cf1d9f8f4 could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:57:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:04 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:57:04 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:57:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.346s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:04 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Deleted allocations for instance 87b2703e-0154-445e-b659-5f5cf1d9f8f4
Nov 16 00:57:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-25119087-ce3b-47fd-90d8-8684d49bf98a tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.649s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-0df3175b-05a7-4b34-b65c-5eea176c76fa req-de27b9d6-55a8-4068-860f-724df294a3fb service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Received event network-vif-plugged-80c45b41-fa0d-48f6-8006-367e6c52e6d1 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0df3175b-05a7-4b34-b65c-5eea176c76fa req-de27b9d6-55a8-4068-860f-724df294a3fb service nova] Acquiring lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0df3175b-05a7-4b34-b65c-5eea176c76fa req-de27b9d6-55a8-4068-860f-724df294a3fb service nova] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-0df3175b-05a7-4b34-b65c-5eea176c76fa req-de27b9d6-55a8-4068-860f-724df294a3fb service nova] Lock "87b2703e-0154-445e-b659-5f5cf1d9f8f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-0df3175b-05a7-4b34-b65c-5eea176c76fa req-de27b9d6-55a8-4068-860f-724df294a3fb service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] No waiting events found dispatching network-vif-plugged-80c45b41-fa0d-48f6-8006-367e6c52e6d1 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:57:05 user nova-compute[75826]: WARNING nova.compute.manager [req-0df3175b-05a7-4b34-b65c-5eea176c76fa req-de27b9d6-55a8-4068-860f-724df294a3fb service nova] [instance: 87b2703e-0154-445e-b659-5f5cf1d9f8f4] Received unexpected event network-vif-plugged-80c45b41-fa0d-48f6-8006-367e6c52e6d1 for instance with vm_state deleted and task_state None.
Nov 16 00:57:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "38a96872-51b5-448d-83c8-f722520d128c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:05 user nova-compute[75826]: INFO nova.compute.manager [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Terminating instance
Nov 16 00:57:05 user nova-compute[75826]: DEBUG nova.compute.manager [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:57:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-6f490e71-70d5-4017-9163-8174a5a65721 req-ff31ac84-58e8-4c59-91a1-478c8512674e service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received event network-vif-unplugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6f490e71-70d5-4017-9163-8174a5a65721 req-ff31ac84-58e8-4c59-91a1-478c8512674e service nova] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6f490e71-70d5-4017-9163-8174a5a65721 req-ff31ac84-58e8-4c59-91a1-478c8512674e service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6f490e71-70d5-4017-9163-8174a5a65721 req-ff31ac84-58e8-4c59-91a1-478c8512674e service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-6f490e71-70d5-4017-9163-8174a5a65721 req-ff31ac84-58e8-4c59-91a1-478c8512674e service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] No waiting events found dispatching network-vif-unplugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-6f490e71-70d5-4017-9163-8174a5a65721 req-ff31ac84-58e8-4c59-91a1-478c8512674e service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received event network-vif-unplugged-5aaa7f08-f7a2-4933-9667-b6e444930366 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:06 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Instance destroyed successfully.
Nov 16 00:57:06 user nova-compute[75826]: DEBUG nova.objects.instance [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lazy-loading 'resources' on Instance uuid 38a96872-51b5-448d-83c8-f722520d128c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:50:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1176128372',display_name='tempest-ServerActionsTestOtherA-server-1176128372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1176128372',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcHp4MQ1nmnfoZHtG9WUM26rOqXSqM447yKb3OZbHurSNdmdHJlgSIOlTsu4HAYreZ++oluuNxFq/KteFOdGXtyepeTckkePgfQai5TpDlxusLQNPtiszvnX3ROIIcIMw==',key_name='tempest-keypair-2013094512',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:52:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-spmosdih',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:54:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=38a96872-51b5-448d-83c8-f722520d128c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "5aaa7f08-f7a2-4933-9667-b6e444930366", "address": "fa:16:3e:05:7b:62", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.44", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5aaa7f08-f7", "ovs_interfaceid": "5aaa7f08-f7a2-4933-9667-b6e444930366", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_vif [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5aaa7f08-f7, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3aef0f25-8cd0-43a8-bde0-cc321ffacf9f) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:06 user nova-compute[75826]: INFO os_vif [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:7b:62,bridge_name='br-int',has_traffic_filtering=True,id=5aaa7f08-f7a2-4933-9667-b6e444930366,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5aaa7f08-f7')
Nov 16 00:57:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GoJBRfEa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:57:06 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1caf1c-be41-4d90-98bd-18f10b5d62eb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:57:06 user nova-compute[75826]: No targets found.
Nov 16 00:57:06 user nova-compute[75826]: iSNS:
Nov 16 00:57:06 user nova-compute[75826]: No targets found.
Nov 16 00:57:06 user nova-compute[75826]: STATIC:
Nov 16 00:57:06 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9
Nov 16 00:57:06 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:57:06 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:57:06 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9
Nov 16 00:57:06 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:57:06 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:57:06 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:57:06 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:57:06 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:57:06 user nova-compute[75826]: FIRMWARE:
Nov 16 00:57:06 user nova-compute[75826]: No targets found.
Nov 16 00:57:06 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:57:06 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:57:06 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fc48dc-5b48-4cbf-8215-885745044824]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d200f87-6369-457e-accc-f05c0eef49da]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:57:06 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:57:06 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:57:06 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:57:06 user nova-compute[75826]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 (non-flash)
Nov 16 00:57:06 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:57:06 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdbc2c5f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9'): ({'sdc'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Removing single pathed devices sdc {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.050s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0647f823-01ea-4b28-8614-694df17787a6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ca58ee-4d8f-4eff-8e93-62ef2bde2212]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Flushing IO for device /dev/sdc {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.035s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f7c077-0545-47de-bd39-70eecacb641b]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.088s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c2e321-de7b-43e9-bf1f-202869492cd7]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_619070b9', '/dev/disk/by-id/scsi-1SCST_BIO619070b9-b5c5ef7cb8a29557', '/dev/disk/by-id/scsi-26235633565663763') {{(pid=85991) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94555d3-9349-43cf-bbe8-07b7d16715d2]: (4, None) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[759474af-2655-4dbb-aae8-8acf6c0c640e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39b3a10-6531-455e-8af0-423f4c931c50]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260]
Nov 16 00:57:06 user nova-compute[75826]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9, portal: 172.16.0.220,3260] successful.
Nov 16 00:57:06 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:deaf5ba5-af12-408d-9a62-d905764b73e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28ae9bc-11b3-4435-9e63-eee7b2017456]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] <== disconnect_volume: return (432ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:57:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:57:06 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Deleting instance files /opt/stack/data/nova/instances/38a96872-51b5-448d-83c8-f722520d128c_del
Nov 16 00:57:06 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Deletion of /opt/stack/data/nova/instances/38a96872-51b5-448d-83c8-f722520d128c_del complete
Nov 16 00:57:07 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:57:07 user nova-compute[75826]: INFO nova.compute.manager [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Took 1.31 seconds to destroy the instance on the hypervisor.
Nov 16 00:57:07 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:57:07 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:57:07 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 38a96872-51b5-448d-83c8-f722520d128c] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:57:07 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:57:07 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Took 0.70 seconds to deallocate network for instance.
Nov 16 00:57:07 user nova-compute[75826]: DEBUG nova.compute.manager [req-d98a9da2-190b-4df7-8f59-7a4a857b144e req-4d797e26-b243-439a-9a72-25edc083fbdc service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received event network-vif-deleted-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:08 user nova-compute[75826]: DEBUG nova.compute.manager [req-18a14d51-8c5f-4626-8440-df0f5c2cc680 req-4f7287bf-9ed8-4506-a4b5-f5c7831ac31e service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received event network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-18a14d51-8c5f-4626-8440-df0f5c2cc680 req-4f7287bf-9ed8-4506-a4b5-f5c7831ac31e service nova] Acquiring lock "38a96872-51b5-448d-83c8-f722520d128c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-18a14d51-8c5f-4626-8440-df0f5c2cc680 req-4f7287bf-9ed8-4506-a4b5-f5c7831ac31e service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-18a14d51-8c5f-4626-8440-df0f5c2cc680 req-4f7287bf-9ed8-4506-a4b5-f5c7831ac31e service nova] Lock "38a96872-51b5-448d-83c8-f722520d128c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:08 user nova-compute[75826]: DEBUG nova.compute.manager [req-18a14d51-8c5f-4626-8440-df0f5c2cc680 req-4f7287bf-9ed8-4506-a4b5-f5c7831ac31e service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] No waiting events found dispatching network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:57:08 user nova-compute[75826]: WARNING nova.compute.manager [req-18a14d51-8c5f-4626-8440-df0f5c2cc680 req-4f7287bf-9ed8-4506-a4b5-f5c7831ac31e service nova] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Received unexpected event network-vif-plugged-5aaa7f08-f7a2-4933-9667-b6e444930366 for instance with vm_state active and task_state deleting.
Nov 16 00:57:08 user nova-compute[75826]: INFO nova.compute.manager [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Took 0.84 seconds to detach 1 volumes for instance.
Nov 16 00:57:08 user nova-compute[75826]: DEBUG nova.compute.manager [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: 38a96872-51b5-448d-83c8-f722520d128c] Deleting volume: deaf5ba5-af12-408d-9a62-d905764b73e9 {{(pid=75826) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 00:57:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:09 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:57:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:57:09 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:57:09 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:57:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-cc77d9aa-4052-40dd-9495-3a516d8f0793" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:57:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-cc77d9aa-4052-40dd-9495-3a516d8f0793" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:57:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:57:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:09 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Deleted allocations for instance 38a96872-51b5-448d-83c8-f722520d128c
Nov 16 00:57:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-78e54df8-6290-441d-8df0-59dcba5ebe3a tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "38a96872-51b5-448d-83c8-f722520d128c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.522s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Updating instance_info_cache with network_info: [{"id": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "address": "fa:16:3e:b7:91:3a", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606b703-1a", "ovs_interfaceid": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:57:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-cc77d9aa-4052-40dd-9495-3a516d8f0793" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:57:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:57:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:11 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:57:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:57:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:14 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:57:14 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7622MB free_disk=25.106536865234375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance cc77d9aa-4052-40dd-9495-3a516d8f0793 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance f2aeb101-4454-4a86-9e77-9426c732d526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance da626640-fed0-4b78-a62b-4d946f9e64ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.493s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:17 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:57:17 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:57:17 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:57:17 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:57:17 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:57:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:57:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:22 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:57:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:28 user nova-compute[75826]: DEBUG nova.compute.manager [req-8093997b-3435-4d8e-ab5a-d228d659265a req-93eda5e2-961c-420e-a047-31bb499fc4f1 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received event network-changed-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:28 user nova-compute[75826]: DEBUG nova.compute.manager [req-8093997b-3435-4d8e-ab5a-d228d659265a req-93eda5e2-961c-420e-a047-31bb499fc4f1 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Refreshing instance network info cache due to event network-changed-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:57:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8093997b-3435-4d8e-ab5a-d228d659265a req-93eda5e2-961c-420e-a047-31bb499fc4f1 service nova] Acquiring lock "refresh_cache-24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:57:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8093997b-3435-4d8e-ab5a-d228d659265a req-93eda5e2-961c-420e-a047-31bb499fc4f1 service nova] Acquired lock "refresh_cache-24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:57:28 user nova-compute[75826]: DEBUG nova.network.neutron [req-8093997b-3435-4d8e-ab5a-d228d659265a req-93eda5e2-961c-420e-a047-31bb499fc4f1 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Refreshing network info cache for port 65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:57:28 user nova-compute[75826]: DEBUG nova.network.neutron [req-8093997b-3435-4d8e-ab5a-d228d659265a req-93eda5e2-961c-420e-a047-31bb499fc4f1 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Updated VIF entry in instance network info cache for port 65bc56ab-de8e-44dc-938b-1bb5d84d7fcb. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:57:28 user nova-compute[75826]: DEBUG nova.network.neutron [req-8093997b-3435-4d8e-ab5a-d228d659265a req-93eda5e2-961c-420e-a047-31bb499fc4f1 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Updating instance_info_cache with network_info: [{"id": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "address": "fa:16:3e:f7:30:c4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bc56ab-de", "ovs_interfaceid": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:57:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8093997b-3435-4d8e-ab5a-d228d659265a req-93eda5e2-961c-420e-a047-31bb499fc4f1 service nova] Releasing lock "refresh_cache-24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:57:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:57:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:34 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:57:34 user nova-compute[75826]: INFO nova.compute.claims [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Claim successful on node user
Nov 16 00:57:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:34 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:57:34 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:57:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:57:35 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:57:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:57:35 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:57:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:57:35 user nova-compute[75826]: INFO nova.virt.block_device [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Booting with volume snapshot 6b52ac57-c4a0-4adc-8a89-0e3f4e5d72d2 at /dev/vda
Nov 16 00:57:35 user nova-compute[75826]: DEBUG nova.policy [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c17265442bc48f9b6de5367e91096b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4135693756414fb70826b0f1d9345c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:57:35 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Successfully created port: 6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:57:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:36 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Successfully updated port: 6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:57:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "refresh_cache-9f9e020d-2ebf-4ea4-bc70-cac80f34643f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:57:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquired lock "refresh_cache-9f9e020d-2ebf-4ea4-bc70-cac80f34643f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:57:36 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:57:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-99f0f03d-aca9-4c00-a0f6-2edbe0d2d81d req-5671b2fe-eddd-44c4-a059-c027fc315eee service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Received event network-changed-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:36 user nova-compute[75826]: DEBUG nova.compute.manager [req-99f0f03d-aca9-4c00-a0f6-2edbe0d2d81d req-5671b2fe-eddd-44c4-a059-c027fc315eee service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Refreshing instance network info cache due to event network-changed-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:57:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-99f0f03d-aca9-4c00-a0f6-2edbe0d2d81d req-5671b2fe-eddd-44c4-a059-c027fc315eee service nova] Acquiring lock "refresh_cache-9f9e020d-2ebf-4ea4-bc70-cac80f34643f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:57:36 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:57:37 user nova-compute[75826]: DEBUG nova.network.neutron [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Updating instance_info_cache with network_info: [{"id": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "address": "fa:16:3e:69:c8:f9", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf936-eb", "ovs_interfaceid": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:57:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Releasing lock "refresh_cache-9f9e020d-2ebf-4ea4-bc70-cac80f34643f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:57:37 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Instance network_info: |[{"id": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "address": "fa:16:3e:69:c8:f9", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf936-eb", "ovs_interfaceid": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:57:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-99f0f03d-aca9-4c00-a0f6-2edbe0d2d81d req-5671b2fe-eddd-44c4-a059-c027fc315eee service nova] Acquired lock "refresh_cache-9f9e020d-2ebf-4ea4-bc70-cac80f34643f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:57:37 user nova-compute[75826]: DEBUG nova.network.neutron [req-99f0f03d-aca9-4c00-a0f6-2edbe0d2d81d req-5671b2fe-eddd-44c4-a059-c027fc315eee service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Refreshing network info cache for port 6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:57:37 user nova-compute[75826]: DEBUG nova.network.neutron [req-99f0f03d-aca9-4c00-a0f6-2edbe0d2d81d req-5671b2fe-eddd-44c4-a059-c027fc315eee service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Updated VIF entry in instance network info cache for port 6afaf936-ebb9-4eac-a1cc-89ee3f9dae65. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:57:37 user nova-compute[75826]: DEBUG nova.network.neutron [req-99f0f03d-aca9-4c00-a0f6-2edbe0d2d81d req-5671b2fe-eddd-44c4-a059-c027fc315eee service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Updating instance_info_cache with network_info: [{"id": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "address": "fa:16:3e:69:c8:f9", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf936-eb", "ovs_interfaceid": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:57:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-99f0f03d-aca9-4c00-a0f6-2edbe0d2d81d req-5671b2fe-eddd-44c4-a059-c027fc315eee service nova] Releasing lock "refresh_cache-9f9e020d-2ebf-4ea4-bc70-cac80f34643f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:57:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "cc77d9aa-4052-40dd-9495-3a516d8f0793" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:39 user nova-compute[75826]: INFO nova.compute.manager [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Terminating instance
Nov 16 00:57:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-f82f0552-186a-4564-bf53-468dc0ddaefc req-af74fee4-edb2-49b8-bd25-7922e7e7a2df service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Received event network-vif-unplugged-c606b703-1a65-4ec2-abba-8445bf5c0e26 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f82f0552-186a-4564-bf53-468dc0ddaefc req-af74fee4-edb2-49b8-bd25-7922e7e7a2df service nova] Acquiring lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f82f0552-186a-4564-bf53-468dc0ddaefc req-af74fee4-edb2-49b8-bd25-7922e7e7a2df service nova] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f82f0552-186a-4564-bf53-468dc0ddaefc req-af74fee4-edb2-49b8-bd25-7922e7e7a2df service nova] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-f82f0552-186a-4564-bf53-468dc0ddaefc req-af74fee4-edb2-49b8-bd25-7922e7e7a2df service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] No waiting events found dispatching network-vif-unplugged-c606b703-1a65-4ec2-abba-8445bf5c0e26 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-f82f0552-186a-4564-bf53-468dc0ddaefc req-af74fee4-edb2-49b8-bd25-7922e7e7a2df service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Received event network-vif-unplugged-c606b703-1a65-4ec2-abba-8445bf5c0e26 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:57:40 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Instance destroyed successfully.
Nov 16 00:57:40 user nova-compute[75826]: DEBUG nova.objects.instance [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lazy-loading 'resources' on Instance uuid cc77d9aa-4052-40dd-9495-3a516d8f0793 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:48:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-646461662',display_name='tempest-ServersNegativeTestJSON-server-646461662',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-646461662',id=29,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:49:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='328112cf55d04d8c8bb1b9d5655a2115',ramdisk_id='',reservation_id='r-3779duek',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1135241657',owner_user_name='tempest-ServersNegativeTestJSON-1135241657-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:49:02Z,user_data=None,user_id='d7ea010b69874f3eb8947e93531e6669',uuid=cc77d9aa-4052-40dd-9495-3a516d8f0793,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "address": "fa:16:3e:b7:91:3a", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606b703-1a", "ovs_interfaceid": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Converting VIF {"id": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "address": "fa:16:3e:b7:91:3a", "network": {"id": "2d1f92be-b841-4a7d-adc0-55b51d19b01e", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1434189858-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "328112cf55d04d8c8bb1b9d5655a2115", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc606b703-1a", "ovs_interfaceid": "c606b703-1a65-4ec2-abba-8445bf5c0e26", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:91:3a,bridge_name='br-int',has_traffic_filtering=True,id=c606b703-1a65-4ec2-abba-8445bf5c0e26,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606b703-1a') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG os_vif [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:91:3a,bridge_name='br-int',has_traffic_filtering=True,id=c606b703-1a65-4ec2-abba-8445bf5c0e26,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606b703-1a') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc606b703-1a, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9481bc3-2a95-4cc8-8d74-6c0f9bc0ab83) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:57:40 user nova-compute[75826]: INFO os_vif [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:91:3a,bridge_name='br-int',has_traffic_filtering=True,id=c606b703-1a65-4ec2-abba-8445bf5c0e26,network=Network(2d1f92be-b841-4a7d-adc0-55b51d19b01e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc606b703-1a')
Nov 16 00:57:40 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Deleting instance files /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793_del
Nov 16 00:57:40 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Deletion of /opt/stack/data/nova/instances/cc77d9aa-4052-40dd-9495-3a516d8f0793_del complete
Nov 16 00:57:40 user nova-compute[75826]: INFO nova.compute.manager [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG os_brick.utils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[96e9b264-99af-4e50-bb11-6261d29544fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0f784d-33e8-464c-ae38-85c9828ff9e9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd61a698-7b52-4ec3-bba4-e4e8b6956051]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[143fa4cd-d8d2-4c42-ac28-3c1ebd7338bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:57:41 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:57:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7144a45-3121-4554-bade-57aa4d15dc83]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG os_brick.utils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Updating existing volume attachment record: da0cbaf9-b3a6-4aa8-a22b-4881244147ba {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-75e2f2c4-5c87-4f36-a7aa-f737ebc0fd51 req-5c4a15ee-3368-4a0d-88a1-c5730896d5f6 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Received event network-vif-deleted-c606b703-1a65-4ec2-abba-8445bf5c0e26 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:41 user nova-compute[75826]: INFO nova.compute.manager [req-75e2f2c4-5c87-4f36-a7aa-f737ebc0fd51 req-5c4a15ee-3368-4a0d-88a1-c5730896d5f6 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Neutron deleted interface c606b703-1a65-4ec2-abba-8445bf5c0e26; detaching it from the instance and deleting it from the info cache
Nov 16 00:57:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-75e2f2c4-5c87-4f36-a7aa-f737ebc0fd51 req-5c4a15ee-3368-4a0d-88a1-c5730896d5f6 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:57:41 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Took 0.54 seconds to deallocate network for instance.
Nov 16 00:57:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-75e2f2c4-5c87-4f36-a7aa-f737ebc0fd51 req-5c4a15ee-3368-4a0d-88a1-c5730896d5f6 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Detach interface failed, port_id=c606b703-1a65-4ec2-abba-8445bf5c0e26, reason: Instance cc77d9aa-4052-40dd-9495-3a516d8f0793 could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:57:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.360s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:41 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Deleted allocations for instance cc77d9aa-4052-40dd-9495-3a516d8f0793
Nov 16 00:57:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3009f1b6-f4a5-492c-b6e8-6d666bad2bd4 tempest-ServersNegativeTestJSON-1135241657 tempest-ServersNegativeTestJSON-1135241657-project-member] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.968s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-da15db69-e16d-4042-b721-46da45e0c525 req-246d9b27-b75f-461f-8974-76d889030ac4 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Received event network-vif-plugged-c606b703-1a65-4ec2-abba-8445bf5c0e26 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-da15db69-e16d-4042-b721-46da45e0c525 req-246d9b27-b75f-461f-8974-76d889030ac4 service nova] Acquiring lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-da15db69-e16d-4042-b721-46da45e0c525 req-246d9b27-b75f-461f-8974-76d889030ac4 service nova] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-da15db69-e16d-4042-b721-46da45e0c525 req-246d9b27-b75f-461f-8974-76d889030ac4 service nova] Lock "cc77d9aa-4052-40dd-9495-3a516d8f0793-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-da15db69-e16d-4042-b721-46da45e0c525 req-246d9b27-b75f-461f-8974-76d889030ac4 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] No waiting events found dispatching network-vif-plugged-c606b703-1a65-4ec2-abba-8445bf5c0e26 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:57:42 user nova-compute[75826]: WARNING nova.compute.manager [req-da15db69-e16d-4042-b721-46da45e0c525 req-246d9b27-b75f-461f-8974-76d889030ac4 service nova] [instance: cc77d9aa-4052-40dd-9495-3a516d8f0793] Received unexpected event network-vif-plugged-c606b703-1a65-4ec2-abba-8445bf5c0e26 for instance with vm_state deleted and task_state None.
Nov 16 00:57:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:57:46 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Creating image(s)
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Ensure instance console log exists: /opt/stack/data/nova/instances/9f9e020d-2ebf-4ea4-bc70-cac80f34643f/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Start _get_guest_xml network_info=[{"id": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "address": "fa:16:3e:69:c8:f9", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf936-eb", "ovs_interfaceid": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T00:57:29Z,direct_url=<?>,disk_format='qcow2',id=5d20c58c-e049-4d5b-ad36-885d062deb42,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1308899410',owner='ef4135693756414fb70826b0f1d9345c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T00:57:31Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'da0cbaf9-b3a6-4aa8-a22b-4881244147ba', 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiTOgWtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f9e020d-2ebf-4ea4-bc70-cac80f34643f', 'attached_at': '', 'detached_at': '', 'volume_id': '3eed8e09-4b8f-4161-96e7-1a9bd06ca71c', 'serial': '3eed8e09-4b8f-4161-96e7-1a9bd06ca71c'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:57:46 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:57:46 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-16T00:57:29Z,direct_url=<?>,disk_format='qcow2',id=5d20c58c-e049-4d5b-ad36-885d062deb42,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1308899410',owner='ef4135693756414fb70826b0f1d9345c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-16T00:57:31Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiTOgWtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:57:46 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:57:46 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:57:46 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc8092b-39e0-4c56-b5f3-1ee0c320febe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:57:46 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1520d9-0f44-4f30-9db1-01bca6b79201]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c] added
Nov 16 00:57:46 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[06609fa1-36f4-45e0-8437-e714a4cbe7c4]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33758ae-9889-44aa-ad94-486d46b8909c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XiTOgWtd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XiTOgWtd" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5354308-3490-4dcd-a522-7d73d7578bdd]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XiTOgWtd'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[859b8c62-ec06-4d9c-8b15-3b3479c53f1a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[949a221f-59c0-4780-9174-708a6e1740d9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:57:46 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:57:46 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:57:46 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:57:46 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[05f1bf9c-4e88-49d2-a40d-c8a0ff20cbb5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c, portal: 172.16.0.220,3260]
Nov 16 00:57:46 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c, portal: 172.16.0.220,3260] successful.
Nov 16 00:57:46 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6df6cff2-daf4-47f8-9a17-a80f24318c12]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ae4916-c5ae-4528-ab36-43fa85fae4da]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:57:46 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:57:46 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:57:46 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:57:46 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:57:46 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:57:46 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[741c6e2a-cda4-4765-baac-3a3838ede306]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:46 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiTOgWtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26136356663353163', 'path': '/dev/sdc'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26136356663353163', 'path': '/dev/sdc'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1587900635',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1587900635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1587900635',id=41,image_ref='5d20c58c-e049-4d5b-ad36-885d062deb42',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInrK3DsPJNTVikdUNHecFcuY1iMYQFpCvUXewQrfbWZvFc9gCZPPCPNvBNN8MflUI7yjB6Z0OLSrZJnTS3nNmE6GBqiwpf4S9Z+H0efVSYt/5uEjnQCMKdNxXNNP0C4Ow==',key_name='tempest-keypair-1806925161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-4amzkebp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2108626012',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c17265442bc48f9b6de5367e91096b2',uuid=9f9e020d-2ebf-4ea4-bc70-cac80f34643f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "address": "fa:16:3e:69:c8:f9", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf936-eb", "ovs_interfaceid": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "address": "fa:16:3e:69:c8:f9", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf936-eb", "ovs_interfaceid": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=6afaf936-ebb9-4eac-a1cc-89ee3f9dae65,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf936-eb') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG nova.objects.instance [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f9e020d-2ebf-4ea4-bc70-cac80f34643f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:57:47 user nova-compute[75826]:   <uuid>9f9e020d-2ebf-4ea4-bc70-cac80f34643f</uuid>
Nov 16 00:57:47 user nova-compute[75826]:   <name>instance-00000029</name>
Nov 16 00:57:47 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:57:47 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:57:47 user nova-compute[75826]:   <metadata>
Nov 16 00:57:47 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:57:47 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:57:47 user nova-compute[75826]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1587900635</nova:name>
Nov 16 00:57:47 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:57:46</nova:creationTime>
Nov 16 00:57:47 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:57:47 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:57:47 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:57:47 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:57:47 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:57:47 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:57:47 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:57:47 user nova-compute[75826]:       <nova:owner>
Nov 16 00:57:47 user nova-compute[75826]:         <nova:user uuid="6c17265442bc48f9b6de5367e91096b2">tempest-TestVolumeBootPattern-2108626012-project-member</nova:user>
Nov 16 00:57:47 user nova-compute[75826]:         <nova:project uuid="ef4135693756414fb70826b0f1d9345c">tempest-TestVolumeBootPattern-2108626012</nova:project>
Nov 16 00:57:47 user nova-compute[75826]:       </nova:owner>
Nov 16 00:57:47 user nova-compute[75826]:       <nova:root type="image" uuid="5d20c58c-e049-4d5b-ad36-885d062deb42"/>
Nov 16 00:57:47 user nova-compute[75826]:       <nova:ports>
Nov 16 00:57:47 user nova-compute[75826]:         <nova:port uuid="6afaf936-ebb9-4eac-a1cc-89ee3f9dae65">
Nov 16 00:57:47 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 00:57:47 user nova-compute[75826]:         </nova:port>
Nov 16 00:57:47 user nova-compute[75826]:       </nova:ports>
Nov 16 00:57:47 user nova-compute[75826]:     </nova:instance>
Nov 16 00:57:47 user nova-compute[75826]:   </metadata>
Nov 16 00:57:47 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:57:47 user nova-compute[75826]:     <system>
Nov 16 00:57:47 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:57:47 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:57:47 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:57:47 user nova-compute[75826]:       <entry name="serial">9f9e020d-2ebf-4ea4-bc70-cac80f34643f</entry>
Nov 16 00:57:47 user nova-compute[75826]:       <entry name="uuid">9f9e020d-2ebf-4ea4-bc70-cac80f34643f</entry>
Nov 16 00:57:47 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:57:47 user nova-compute[75826]:     </system>
Nov 16 00:57:47 user nova-compute[75826]:   </sysinfo>
Nov 16 00:57:47 user nova-compute[75826]:   <os>
Nov 16 00:57:47 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:57:47 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:57:47 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:57:47 user nova-compute[75826]:   </os>
Nov 16 00:57:47 user nova-compute[75826]:   <features>
Nov 16 00:57:47 user nova-compute[75826]:     <acpi/>
Nov 16 00:57:47 user nova-compute[75826]:     <apic/>
Nov 16 00:57:47 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:57:47 user nova-compute[75826]:   </features>
Nov 16 00:57:47 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:57:47 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:57:47 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:57:47 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:57:47 user nova-compute[75826]:   </clock>
Nov 16 00:57:47 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:57:47 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:57:47 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:57:47 user nova-compute[75826]:   </cpu>
Nov 16 00:57:47 user nova-compute[75826]:   <devices>
Nov 16 00:57:47 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:57:47 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:57:47 user nova-compute[75826]:       <source dev="/dev/sdc"/>
Nov 16 00:57:47 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:57:47 user nova-compute[75826]:       <serial>3eed8e09-4b8f-4161-96e7-1a9bd06ca71c</serial>
Nov 16 00:57:47 user nova-compute[75826]:     </disk>
Nov 16 00:57:47 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:57:47 user nova-compute[75826]:       <mac address="fa:16:3e:69:c8:f9"/>
Nov 16 00:57:47 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:57:47 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:57:47 user nova-compute[75826]:       <target dev="tap6afaf936-eb"/>
Nov 16 00:57:47 user nova-compute[75826]:     </interface>
Nov 16 00:57:47 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:57:47 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/9f9e020d-2ebf-4ea4-bc70-cac80f34643f/console.log" append="off"/>
Nov 16 00:57:47 user nova-compute[75826]:     </serial>
Nov 16 00:57:47 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:57:47 user nova-compute[75826]:     <video>
Nov 16 00:57:47 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:57:47 user nova-compute[75826]:     </video>
Nov 16 00:57:47 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:57:47 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:57:47 user nova-compute[75826]:     </rng>
Nov 16 00:57:47 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:57:47 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:57:47 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:57:47 user nova-compute[75826]:     </memballoon>
Nov 16 00:57:47 user nova-compute[75826]:   </devices>
Nov 16 00:57:47 user nova-compute[75826]: </domain>
Nov 16 00:57:47 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1587900635',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1587900635',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1587900635',id=41,image_ref='5d20c58c-e049-4d5b-ad36-885d062deb42',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInrK3DsPJNTVikdUNHecFcuY1iMYQFpCvUXewQrfbWZvFc9gCZPPCPNvBNN8MflUI7yjB6Z0OLSrZJnTS3nNmE6GBqiwpf4S9Z+H0efVSYt/5uEjnQCMKdNxXNNP0C4Ow==',key_name='tempest-keypair-1806925161',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-4amzkebp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2108626012',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:57:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c17265442bc48f9b6de5367e91096b2',uuid=9f9e020d-2ebf-4ea4-bc70-cac80f34643f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "address": "fa:16:3e:69:c8:f9", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf936-eb", "ovs_interfaceid": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "address": "fa:16:3e:69:c8:f9", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf936-eb", "ovs_interfaceid": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=6afaf936-ebb9-4eac-a1cc-89ee3f9dae65,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf936-eb') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG os_vif [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=6afaf936-ebb9-4eac-a1cc-89ee3f9dae65,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf936-eb') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67ab71e2-6f13-5372-b472-0c4984592e3e', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6afaf936-eb, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6afaf936-eb, col_values=(('qos', UUID('df829e68-0176-4f38-805b-ec01291775fe')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6afaf936-eb, col_values=(('external_ids', {'iface-id': '6afaf936-ebb9-4eac-a1cc-89ee3f9dae65', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:c8:f9', 'vm-uuid': '9f9e020d-2ebf-4ea4-bc70-cac80f34643f'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:47 user nova-compute[75826]: INFO os_vif [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=6afaf936-ebb9-4eac-a1cc-89ee3f9dae65,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf936-eb')
Nov 16 00:57:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:57:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] No VIF found with MAC fa:16:3e:69:c8:f9, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:57:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-e42b2c39-5847-4157-8763-9036b0f8127e req-527b02f6-a501-4b59-bfb3-c5dfd31c26c8 service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Received event network-vif-plugged-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e42b2c39-5847-4157-8763-9036b0f8127e req-527b02f6-a501-4b59-bfb3-c5dfd31c26c8 service nova] Acquiring lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e42b2c39-5847-4157-8763-9036b0f8127e req-527b02f6-a501-4b59-bfb3-c5dfd31c26c8 service nova] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e42b2c39-5847-4157-8763-9036b0f8127e req-527b02f6-a501-4b59-bfb3-c5dfd31c26c8 service nova] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:49 user nova-compute[75826]: DEBUG nova.compute.manager [req-e42b2c39-5847-4157-8763-9036b0f8127e req-527b02f6-a501-4b59-bfb3-c5dfd31c26c8 service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] No waiting events found dispatching network-vif-plugged-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:57:49 user nova-compute[75826]: WARNING nova.compute.manager [req-e42b2c39-5847-4157-8763-9036b0f8127e req-527b02f6-a501-4b59-bfb3-c5dfd31c26c8 service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Received unexpected event network-vif-plugged-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 for instance with vm_state building and task_state spawning.
Nov 16 00:57:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:57:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:57:50 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Instance spawned successfully.
Nov 16 00:57:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:57:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:57:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:57:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-f303f464-c33f-43f3-9359-e71433f7c7b0 req-fb6b14d6-b328-42a2-86d9-28739b9102af service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Received event network-vif-plugged-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f303f464-c33f-43f3-9359-e71433f7c7b0 req-fb6b14d6-b328-42a2-86d9-28739b9102af service nova] Acquiring lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f303f464-c33f-43f3-9359-e71433f7c7b0 req-fb6b14d6-b328-42a2-86d9-28739b9102af service nova] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f303f464-c33f-43f3-9359-e71433f7c7b0 req-fb6b14d6-b328-42a2-86d9-28739b9102af service nova] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-f303f464-c33f-43f3-9359-e71433f7c7b0 req-fb6b14d6-b328-42a2-86d9-28739b9102af service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] No waiting events found dispatching network-vif-plugged-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:57:51 user nova-compute[75826]: WARNING nova.compute.manager [req-f303f464-c33f-43f3-9359-e71433f7c7b0 req-fb6b14d6-b328-42a2-86d9-28739b9102af service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Received unexpected event network-vif-plugged-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 for instance with vm_state building and task_state spawning.
Nov 16 00:57:51 user nova-compute[75826]: INFO nova.compute.manager [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Took 5.02 seconds to spawn the instance on the hypervisor.
Nov 16 00:57:51 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:57:51 user nova-compute[75826]: INFO nova.compute.manager [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Took 16.73 seconds to build instance.
Nov 16 00:57:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3202642b-939a-43d7-a5e3-384bcca2b870 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.831s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:53 user nova-compute[75826]: INFO nova.compute.manager [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Terminating instance
Nov 16 00:57:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:57:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-10360618-0236-4097-b90c-3ba52623909a req-55f729bf-e1f3-424f-8749-44e8f95df469 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-unplugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-10360618-0236-4097-b90c-3ba52623909a req-55f729bf-e1f3-424f-8749-44e8f95df469 service nova] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-10360618-0236-4097-b90c-3ba52623909a req-55f729bf-e1f3-424f-8749-44e8f95df469 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-10360618-0236-4097-b90c-3ba52623909a req-55f729bf-e1f3-424f-8749-44e8f95df469 service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-10360618-0236-4097-b90c-3ba52623909a req-55f729bf-e1f3-424f-8749-44e8f95df469 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] No waiting events found dispatching network-vif-unplugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:57:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-10360618-0236-4097-b90c-3ba52623909a req-55f729bf-e1f3-424f-8749-44e8f95df469 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-unplugged-9a741ee6-00d4-49d0-8562-3ece777615c8 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:54 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Instance destroyed successfully.
Nov 16 00:57:54 user nova-compute[75826]: DEBUG nova.objects.instance [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'resources' on Instance uuid 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:42:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1180544394',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1180544394',id=13,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:44:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-wr2i12dl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:45:51Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "9a741ee6-00d4-49d0-8562-3ece777615c8", "address": "fa:16:3e:f5:64:fa", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9a741ee6-00", "ovs_interfaceid": "9a741ee6-00d4-49d0-8562-3ece777615c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:64:fa,bridge_name='br-int',has_traffic_filtering=True,id=9a741ee6-00d4-49d0-8562-3ece777615c8,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a741ee6-00') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_vif [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:64:fa,bridge_name='br-int',has_traffic_filtering=True,id=9a741ee6-00d4-49d0-8562-3ece777615c8,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a741ee6-00') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9a741ee6-00, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=15cce8e4-eaf7-4743-9c19-fad2c1114108) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:54 user nova-compute[75826]: INFO os_vif [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:64:fa,bridge_name='br-int',has_traffic_filtering=True,id=9a741ee6-00d4-49d0-8562-3ece777615c8,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9a741ee6-00')
Nov 16 00:57:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GZOvXJio', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:57:54 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3590f2-b0cb-442a-87de-392e8cb43ed0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:57:54 user nova-compute[75826]: No targets found.
Nov 16 00:57:54 user nova-compute[75826]: iSNS:
Nov 16 00:57:54 user nova-compute[75826]: No targets found.
Nov 16 00:57:54 user nova-compute[75826]: STATIC:
Nov 16 00:57:54 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c
Nov 16 00:57:54 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:57:54 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:57:54 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9
Nov 16 00:57:54 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:57:54 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:57:54 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857
Nov 16 00:57:54 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:57:54 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:57:54 user nova-compute[75826]: FIRMWARE:
Nov 16 00:57:54 user nova-compute[75826]: No targets found.
Nov 16 00:57:54 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:57:54 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:57:54 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9381f5d-e61a-4b96-afe9-772592ee88ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7718404d-de62-4896-b19f-07060f4875f1]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:57:54 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:57:54 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:57:54 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 (non-flash)
Nov 16 00:57:54 user nova-compute[75826]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:57:54 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:57:54 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd946f3130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857'): ({'sdb'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Removing single pathed devices sdb {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[56550cbe-d7c2-4dfe-8b1c-2e7bfac79fc3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbfc87b-0e38-415b-a2ee-1fc374f06800]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Flushing IO for device /dev/sdb {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5427f2d3-e272-4c1f-b780-ba1c5759a4ae]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[73b53226-7545-42ca-ace7-ab1e094b4990]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6889c419-c5d7-4718-9225-86ca9e069e90]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c768709-bdc6-45be-a225-d569da8ec44b]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857, portal: 172.16.0.220,3260]
Nov 16 00:57:54 user nova-compute[75826]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857, portal: 172.16.0.220,3260] successful.
Nov 16 00:57:54 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7e39321-f2f6-44b8-88ce-6ea0337e7857 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abc8b5d-46c0-4314-813e-9b0b28073366]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] <== disconnect_volume: return (306ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:57:54 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Deleting instance files /opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c_del
Nov 16 00:57:54 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Deletion of /opt/stack/data/nova/instances/2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c_del complete
Nov 16 00:57:54 user nova-compute[75826]: INFO nova.compute.manager [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 16 00:57:54 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:57:54 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:57:55 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:57:55 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Took 0.60 seconds to deallocate network for instance.
Nov 16 00:57:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-5a9d5017-5ea3-41c1-8132-b5e9f28f269b req-b0a02b4f-4405-4d6f-9e69-c59cbd25bfd5 service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-deleted-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-b9bc88e5-3da9-4877-9f33-0a70b4dbcd4c req-a2a57722-f173-431e-a252-42574bb5b4da service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:57:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b9bc88e5-3da9-4877-9f33-0a70b4dbcd4c req-a2a57722-f173-431e-a252-42574bb5b4da service nova] Acquiring lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b9bc88e5-3da9-4877-9f33-0a70b4dbcd4c req-a2a57722-f173-431e-a252-42574bb5b4da service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b9bc88e5-3da9-4877-9f33-0a70b4dbcd4c req-a2a57722-f173-431e-a252-42574bb5b4da service nova] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-b9bc88e5-3da9-4877-9f33-0a70b4dbcd4c req-a2a57722-f173-431e-a252-42574bb5b4da service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] No waiting events found dispatching network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:57:55 user nova-compute[75826]: WARNING nova.compute.manager [req-b9bc88e5-3da9-4877-9f33-0a70b4dbcd4c req-a2a57722-f173-431e-a252-42574bb5b4da service nova] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Received unexpected event network-vif-plugged-9a741ee6-00d4-49d0-8562-3ece777615c8 for instance with vm_state active and task_state deleting.
Nov 16 00:57:56 user nova-compute[75826]: INFO nova.compute.manager [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c] Took 0.85 seconds to detach 1 volumes for instance.
Nov 16 00:57:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:56 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:57:56 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:57:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:56 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Deleted allocations for instance 2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c
Nov 16 00:57:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-999203fd-acef-4968-936c-f39f0a61c35c tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "2ecacdf0-895a-4a4d-a5d8-460cfaecdf5c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.254s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:57:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:57:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:57:59 user nova-compute[75826]: INFO nova.compute.manager [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Terminating instance
Nov 16 00:57:59 user nova-compute[75826]: DEBUG nova.compute.manager [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:57:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:57:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-a0cec65e-00f8-47e5-be79-ac5cb6faad7b req-8c510f96-4127-4f14-93d2-4251a16f741a service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Received event network-vif-unplugged-95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a0cec65e-00f8-47e5-be79-ac5cb6faad7b req-8c510f96-4127-4f14-93d2-4251a16f741a service nova] Acquiring lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a0cec65e-00f8-47e5-be79-ac5cb6faad7b req-8c510f96-4127-4f14-93d2-4251a16f741a service nova] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a0cec65e-00f8-47e5-be79-ac5cb6faad7b req-8c510f96-4127-4f14-93d2-4251a16f741a service nova] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-a0cec65e-00f8-47e5-be79-ac5cb6faad7b req-8c510f96-4127-4f14-93d2-4251a16f741a service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] No waiting events found dispatching network-vif-unplugged-95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-a0cec65e-00f8-47e5-be79-ac5cb6faad7b req-8c510f96-4127-4f14-93d2-4251a16f741a service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Received event network-vif-unplugged-95244a55-3c22-4eb7-ada5-7c20002f8728 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:58:00 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Instance destroyed successfully.
Nov 16 00:58:00 user nova-compute[75826]: DEBUG nova.objects.instance [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lazy-loading 'resources' on Instance uuid ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1012088855',display_name='tempest-ServerActionsTestOtherA-server-1012088855',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1012088855',id=3,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHcHp4MQ1nmnfoZHtG9WUM26rOqXSqM447yKb3OZbHurSNdmdHJlgSIOlTsu4HAYreZ++oluuNxFq/KteFOdGXtyepeTckkePgfQai5TpDlxusLQNPtiszvnX3ROIIcIMw==',key_name='tempest-keypair-2013094512',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4d0d81c4b6d0415681092d61ea35de51',ramdisk_id='',reservation_id='r-xd6m7q91',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-329506797',owner_user_name='tempest-ServerActionsTestOtherA-329506797-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:39:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055179a465cc4327b4ce68af5018608c',uuid=ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converting VIF {"id": "95244a55-3c22-4eb7-ada5-7c20002f8728", "address": "fa:16:3e:20:3e:e0", "network": {"id": "9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-808749216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4d0d81c4b6d0415681092d61ea35de51", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95244a55-3c", "ovs_interfaceid": "95244a55-3c22-4eb7-ada5-7c20002f8728", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:3e:e0,bridge_name='br-int',has_traffic_filtering=True,id=95244a55-3c22-4eb7-ada5-7c20002f8728,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95244a55-3c') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG os_vif [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:3e:e0,bridge_name='br-int',has_traffic_filtering=True,id=95244a55-3c22-4eb7-ada5-7c20002f8728,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95244a55-3c') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95244a55-3c, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d7e1169-2d4b-4e28-a960-4d59329c6547) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:58:00 user nova-compute[75826]: INFO os_vif [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:3e:e0,bridge_name='br-int',has_traffic_filtering=True,id=95244a55-3c22-4eb7-ada5-7c20002f8728,network=Network(9904b13c-9e6d-4d32-9d3f-4dd8fcb8fd5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95244a55-3c')
Nov 16 00:58:00 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Deleting instance files /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62_del
Nov 16 00:58:00 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Deletion of /opt/stack/data/nova/instances/ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62_del complete
Nov 16 00:58:00 user nova-compute[75826]: INFO nova.compute.manager [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 00:58:00 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:58:00 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:58:01 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:58:01 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Took 0.50 seconds to deallocate network for instance.
Nov 16 00:58:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-2d0b0c4a-4802-4339-a0ae-16caedc42311 req-4a02ba86-ef2c-4d74-88cd-5f1a5f87704b service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Received event network-vif-deleted-95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:01 user nova-compute[75826]: INFO nova.compute.manager [req-2d0b0c4a-4802-4339-a0ae-16caedc42311 req-4a02ba86-ef2c-4d74-88cd-5f1a5f87704b service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Neutron deleted interface 95244a55-3c22-4eb7-ada5-7c20002f8728; detaching it from the instance and deleting it from the info cache
Nov 16 00:58:01 user nova-compute[75826]: DEBUG nova.network.neutron [req-2d0b0c4a-4802-4339-a0ae-16caedc42311 req-4a02ba86-ef2c-4d74-88cd-5f1a5f87704b service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:58:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-2d0b0c4a-4802-4339-a0ae-16caedc42311 req-4a02ba86-ef2c-4d74-88cd-5f1a5f87704b service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Detach interface failed, port_id=95244a55-3c22-4eb7-ada5-7c20002f8728, reason: Instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62 could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:58:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:01 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:58:01 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:58:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:01 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Deleted allocations for instance ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62
Nov 16 00:58:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-ed6d76be-9809-4a1f-b0b0-a31966f0ef4d tempest-ServerActionsTestOtherA-329506797 tempest-ServerActionsTestOtherA-329506797-project-member] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.910s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-2cadad36-6a53-429f-84da-9952ab8e7f5c req-cafb7065-9872-47ed-be21-c10a6704c325 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Received event network-vif-plugged-95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2cadad36-6a53-429f-84da-9952ab8e7f5c req-cafb7065-9872-47ed-be21-c10a6704c325 service nova] Acquiring lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2cadad36-6a53-429f-84da-9952ab8e7f5c req-cafb7065-9872-47ed-be21-c10a6704c325 service nova] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2cadad36-6a53-429f-84da-9952ab8e7f5c req-cafb7065-9872-47ed-be21-c10a6704c325 service nova] Lock "ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-2cadad36-6a53-429f-84da-9952ab8e7f5c req-cafb7065-9872-47ed-be21-c10a6704c325 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] No waiting events found dispatching network-vif-plugged-95244a55-3c22-4eb7-ada5-7c20002f8728 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:58:02 user nova-compute[75826]: WARNING nova.compute.manager [req-2cadad36-6a53-429f-84da-9952ab8e7f5c req-cafb7065-9872-47ed-be21-c10a6704c325 service nova] [instance: ed26dc7a-5849-47b2-b8c1-e8dd88b8ab62] Received unexpected event network-vif-plugged-95244a55-3c22-4eb7-ada5-7c20002f8728 for instance with vm_state deleted and task_state None.
Nov 16 00:58:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:09 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:58:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:58:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 00:58:09 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:58:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:10 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:58:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:58:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:58:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:15 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:58:15 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7813MB free_disk=25.14889907836914GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance f2aeb101-4454-4a86-9e77-9426c732d526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance da626640-fed0-4b78-a62b-4d946f9e64ea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 9f9e020d-2ebf-4ea4-bc70-cac80f34643f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:58:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:17 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:58:17 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:58:17 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:58:17 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:58:17 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG nova.compute.manager [req-dfdfcb5f-1ece-4b30-af40-7341ad25393d req-c2442d37-1821-49b7-8d1f-a69d6963e6be service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-changed-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG nova.compute.manager [req-dfdfcb5f-1ece-4b30-af40-7341ad25393d req-c2442d37-1821-49b7-8d1f-a69d6963e6be service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Refreshing instance network info cache due to event network-changed-0a09127f-96b6-4230-b058-dc47030afba4. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dfdfcb5f-1ece-4b30-af40-7341ad25393d req-c2442d37-1821-49b7-8d1f-a69d6963e6be service nova] Acquiring lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dfdfcb5f-1ece-4b30-af40-7341ad25393d req-c2442d37-1821-49b7-8d1f-a69d6963e6be service nova] Acquired lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG nova.network.neutron [req-dfdfcb5f-1ece-4b30-af40-7341ad25393d req-c2442d37-1821-49b7-8d1f-a69d6963e6be service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Refreshing network info cache for port 0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "f2aeb101-4454-4a86-9e77-9426c732d526" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG nova.objects.instance [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'flavor' on Instance uuid f2aeb101-4454-4a86-9e77-9426c732d526 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "f2aeb101-4454-4a86-9e77-9426c732d526" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "f2aeb101-4454-4a86-9e77-9426c732d526" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:18 user nova-compute[75826]: INFO nova.compute.manager [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Attaching volume f426f6ce-2d00-41fe-a635-eda1d50bd16d to /dev/vdb
Nov 16 00:58:18 user nova-compute[75826]: DEBUG nova.network.neutron [req-dfdfcb5f-1ece-4b30-af40-7341ad25393d req-c2442d37-1821-49b7-8d1f-a69d6963e6be service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updated VIF entry in instance network info cache for port 0a09127f-96b6-4230-b058-dc47030afba4. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG nova.network.neutron [req-dfdfcb5f-1ece-4b30-af40-7341ad25393d req-c2442d37-1821-49b7-8d1f-a69d6963e6be service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updating instance_info_cache with network_info: [{"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG os_brick.utils [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dfdfcb5f-1ece-4b30-af40-7341ad25393d req-c2442d37-1821-49b7-8d1f-a69d6963e6be service nova] Releasing lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4b5919-f95b-470e-b1f4-c6761242f6c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70de46c-703b-4399-a060-f7cb989718d0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[188a1e59-874d-4ccc-bfaa-30c1ed27b640]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bcf879-be73-453b-9e8a-efd2c1ced2d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:58:18 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:58:18 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7cb64f-c0d3-42f4-9bb1-af717e7e1716]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG os_brick.utils [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:58:18 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updating existing volume attachment record: 2ac8e00e-166c-463d-b8e4-97bfe3eb964f {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:58:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:22 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMobynme', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:58:23 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:58:23 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:58:23 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[97780e2c-d927-45d3-a548-bfbb87ecd8c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:58:23 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9102c5a1-b23b-4c97-ae97-09436a68727e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d] added
Nov 16 00:58:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c7c4ea-5c93-4f89-91f0-693b5e58fc9a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[563e2878-9983-4e8b-ba74-e30aa83f92da]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kMobynme {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kMobynme" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf25edaa-632d-4dd6-b0ab-c99b48f11be2]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kMobynme'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc77540b-dcfd-4110-9cfa-c0d7934d796c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[249f38b4-5a1d-4851-b01f-38574ffc57a6]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:58:23 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:58:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:58:23 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:58:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7222da56-1a95-43e3-82bb-7008053fd2c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d, portal: 172.16.0.220,3260]
Nov 16 00:58:23 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d, portal: 172.16.0.220,3260] successful.
Nov 16 00:58:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f530f77d-caea-4ff3-bd76-85f37aa80cd3]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cf22c4-25de-4cd3-859e-991739f0de92]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:58:23 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:58:23 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:58:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:58:23 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:58:23 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:58:23 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3a2de5-a607-41cf-9847-25a433959d83]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:58:23 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMobynme', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:58:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:58:24 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23433383430363338', 'path': '/dev/sdb'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:58:24 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433383430363338', 'path': '/dev/sdb'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:58:24 user nova-compute[75826]: DEBUG nova.objects.instance [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'flavor' on Instance uuid f2aeb101-4454-4a86-9e77-9426c732d526 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:24 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:58:24 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:58:24 user nova-compute[75826]:   <source dev="/dev/sdb"/>
Nov 16 00:58:24 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:58:24 user nova-compute[75826]:   <serial>f426f6ce-2d00-41fe-a635-eda1d50bd16d</serial>
Nov 16 00:58:24 user nova-compute[75826]: </disk>
Nov 16 00:58:24 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:58:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:58:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:58:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No VIF found with MAC fa:16:3e:b8:e9:47, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:58:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-92cd0d8a-8cfa-4ea3-ab2b-7a8961efd3ee tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "f2aeb101-4454-4a86-9e77-9426c732d526" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.752s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:26 user nova-compute[75826]: INFO nova.compute.manager [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Rescuing
Nov 16 00:58:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:58:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquired lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:58:26 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:58:26 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updating instance_info_cache with network_info: [{"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:58:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Releasing lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-5815eea2-e406-45d4-b829-248891fb4d4d req-23562df5-a639-4334-9d52-cb353dd01011 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-unplugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5815eea2-e406-45d4-b829-248891fb4d4d req-23562df5-a639-4334-9d52-cb353dd01011 service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5815eea2-e406-45d4-b829-248891fb4d4d req-23562df5-a639-4334-9d52-cb353dd01011 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5815eea2-e406-45d4-b829-248891fb4d4d req-23562df5-a639-4334-9d52-cb353dd01011 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-5815eea2-e406-45d4-b829-248891fb4d4d req-23562df5-a639-4334-9d52-cb353dd01011 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-unplugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:58:27 user nova-compute[75826]: WARNING nova.compute.manager [req-5815eea2-e406-45d4-b829-248891fb4d4d req-23562df5-a639-4334-9d52-cb353dd01011 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-unplugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state active and task_state rescuing.
Nov 16 00:58:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:27 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Instance destroyed successfully.
Nov 16 00:58:27 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Attempting rescue
Nov 16 00:58:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75826) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Instance directory exists: not creating {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 00:58:27 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Creating image(s)
Nov 16 00:58:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "/opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "/opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "/opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'trusted_certs' on Instance uuid f2aeb101-4454-4a86-9e77-9426c732d526 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.216s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.rescue {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.rescue" returned: 0 in 0.055s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'migration_context' on Instance uuid f2aeb101-4454-4a86-9e77-9426c732d526 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.objects.base [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<f2aeb101-4454-4a86-9e77-9426c732d526> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Start _get_guest_xml network_info=[{"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "vif_mac": "fa:16:3e:b8:e9:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'resources' on Instance uuid f2aeb101-4454-4a86-9e77-9426c732d526 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.objects.base [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<f2aeb101-4454-4a86-9e77-9426c732d526> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'numa_topology' on Instance uuid f2aeb101-4454-4a86-9e77-9426c732d526 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.objects.base [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<f2aeb101-4454-4a86-9e77-9426c732d526> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:58:28 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:58:28 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'vcpu_model' on Instance uuid f2aeb101-4454-4a86-9e77-9426c732d526 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.objects.base [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<f2aeb101-4454-4a86-9e77-9426c732d526> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:56:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1931447064',display_name='tempest-ServerRescueNegativeTestJSON-server-1931447064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1931447064',id=38,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAO+/aGa62dNPp9RH1R0Wypc9oWDJDToML3kI4x93EPcAtp7goSZTYKzM033CrSv1/iYvpRWEbP4rq0A7+uF0ZZLsb5opD9GCBDwqEXAOlP/s/mAZ00KZ8rAG94DsUIVTw==',key_name='tempest-keypair-1369388165',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:56:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c7dc71f0e2f439f9944bd7410db7e08',ramdisk_id='',reservation_id='r-oug3e018',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2102246851',owner_user_name='tempest-ServerRescueNegativeTestJSON-2102246851-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:56:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='923da525ba264ea4bf770e3a66319655',uuid=f2aeb101-4454-4a86-9e77-9426c732d526,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "vif_mac": "fa:16:3e:b8:e9:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converting VIF {"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "vif_mac": "fa:16:3e:b8:e9:47"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:e9:47,bridge_name='br-int',has_traffic_filtering=True,id=0a09127f-96b6-4230-b058-dc47030afba4,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a09127f-96') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'pci_devices' on Instance uuid f2aeb101-4454-4a86-9e77-9426c732d526 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.objects.base [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Object Instance<f2aeb101-4454-4a86-9e77-9426c732d526> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:58:28 user nova-compute[75826]:   <uuid>f2aeb101-4454-4a86-9e77-9426c732d526</uuid>
Nov 16 00:58:28 user nova-compute[75826]:   <name>instance-00000026</name>
Nov 16 00:58:28 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:58:28 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:58:28 user nova-compute[75826]:   <metadata>
Nov 16 00:58:28 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:58:28 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:58:28 user nova-compute[75826]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1931447064</nova:name>
Nov 16 00:58:28 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:58:28</nova:creationTime>
Nov 16 00:58:28 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:58:28 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:58:28 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:58:28 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:58:28 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:58:28 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:58:28 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:58:28 user nova-compute[75826]:       <nova:owner>
Nov 16 00:58:28 user nova-compute[75826]:         <nova:user uuid="923da525ba264ea4bf770e3a66319655">tempest-ServerRescueNegativeTestJSON-2102246851-project-member</nova:user>
Nov 16 00:58:28 user nova-compute[75826]:         <nova:project uuid="5c7dc71f0e2f439f9944bd7410db7e08">tempest-ServerRescueNegativeTestJSON-2102246851</nova:project>
Nov 16 00:58:28 user nova-compute[75826]:       </nova:owner>
Nov 16 00:58:28 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:58:28 user nova-compute[75826]:       <nova:ports>
Nov 16 00:58:28 user nova-compute[75826]:         <nova:port uuid="0a09127f-96b6-4230-b058-dc47030afba4">
Nov 16 00:58:28 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 00:58:28 user nova-compute[75826]:         </nova:port>
Nov 16 00:58:28 user nova-compute[75826]:       </nova:ports>
Nov 16 00:58:28 user nova-compute[75826]:     </nova:instance>
Nov 16 00:58:28 user nova-compute[75826]:   </metadata>
Nov 16 00:58:28 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:58:28 user nova-compute[75826]:     <system>
Nov 16 00:58:28 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:58:28 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:58:28 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:58:28 user nova-compute[75826]:       <entry name="serial">f2aeb101-4454-4a86-9e77-9426c732d526</entry>
Nov 16 00:58:28 user nova-compute[75826]:       <entry name="uuid">f2aeb101-4454-4a86-9e77-9426c732d526</entry>
Nov 16 00:58:28 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:58:28 user nova-compute[75826]:     </system>
Nov 16 00:58:28 user nova-compute[75826]:   </sysinfo>
Nov 16 00:58:28 user nova-compute[75826]:   <os>
Nov 16 00:58:28 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:58:28 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:58:28 user nova-compute[75826]:   </os>
Nov 16 00:58:28 user nova-compute[75826]:   <features>
Nov 16 00:58:28 user nova-compute[75826]:     <acpi/>
Nov 16 00:58:28 user nova-compute[75826]:     <apic/>
Nov 16 00:58:28 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:58:28 user nova-compute[75826]:   </features>
Nov 16 00:58:28 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:58:28 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:58:28 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:58:28 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:58:28 user nova-compute[75826]:   </clock>
Nov 16 00:58:28 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:58:28 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:58:28 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:58:28 user nova-compute[75826]:   </cpu>
Nov 16 00:58:28 user nova-compute[75826]:   <devices>
Nov 16 00:58:28 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:58:28 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:58:28 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.rescue"/>
Nov 16 00:58:28 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:58:28 user nova-compute[75826]:     </disk>
Nov 16 00:58:28 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:58:28 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:58:28 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk"/>
Nov 16 00:58:28 user nova-compute[75826]:       <target dev="vdb" bus="virtio"/>
Nov 16 00:58:28 user nova-compute[75826]:     </disk>
Nov 16 00:58:28 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:58:28 user nova-compute[75826]:       <mac address="fa:16:3e:b8:e9:47"/>
Nov 16 00:58:28 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:58:28 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:58:28 user nova-compute[75826]:       <target dev="tap0a09127f-96"/>
Nov 16 00:58:28 user nova-compute[75826]:     </interface>
Nov 16 00:58:28 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:58:28 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/console.log" append="off"/>
Nov 16 00:58:28 user nova-compute[75826]:     </serial>
Nov 16 00:58:28 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:58:28 user nova-compute[75826]:     <video>
Nov 16 00:58:28 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:58:28 user nova-compute[75826]:     </video>
Nov 16 00:58:28 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:58:28 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:58:28 user nova-compute[75826]:     </rng>
Nov 16 00:58:28 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:58:28 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:58:28 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:58:28 user nova-compute[75826]:     </memballoon>
Nov 16 00:58:28 user nova-compute[75826]:   </devices>
Nov 16 00:58:28 user nova-compute[75826]: </domain>
Nov 16 00:58:28 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:58:28 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Instance destroyed successfully.
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:58:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] No VIF found with MAC fa:16:3e:b8:e9:47, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:58:29 user nova-compute[75826]: WARNING nova.compute.manager [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state active and task_state rescuing.
Nov 16 00:58:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Received event network-changed-ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Refreshing instance network info cache due to event network-changed-ca0853d2-3703-40f3-970e-b64dae00d399. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] Acquiring lock "refresh_cache-da626640-fed0-4b78-a62b-4d946f9e64ea" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] Acquired lock "refresh_cache-da626640-fed0-4b78-a62b-4d946f9e64ea" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG nova.network.neutron [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Refreshing network info cache for port ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG nova.network.neutron [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Updated VIF entry in instance network info cache for port ca0853d2-3703-40f3-970e-b64dae00d399. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG nova.network.neutron [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Updating instance_info_cache with network_info: [{"id": "ca0853d2-3703-40f3-970e-b64dae00d399", "address": "fa:16:3e:bd:42:d3", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0853d2-37", "ovs_interfaceid": "ca0853d2-3703-40f3-970e-b64dae00d399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c65347b7-492f-4579-be31-b8c115d05842 req-ee14e814-1799-42d3-9551-5dc0aaf0df46 service nova] Releasing lock "refresh_cache-da626640-fed0-4b78-a62b-4d946f9e64ea" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-d2ce1e43-1509-49a8-9ddf-8fd14b8c0e83 req-df2205ff-c0c0-445c-92f6-695f14b748ac service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d2ce1e43-1509-49a8-9ddf-8fd14b8c0e83 req-df2205ff-c0c0-445c-92f6-695f14b748ac service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d2ce1e43-1509-49a8-9ddf-8fd14b8c0e83 req-df2205ff-c0c0-445c-92f6-695f14b748ac service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d2ce1e43-1509-49a8-9ddf-8fd14b8c0e83 req-df2205ff-c0c0-445c-92f6-695f14b748ac service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-d2ce1e43-1509-49a8-9ddf-8fd14b8c0e83 req-df2205ff-c0c0-445c-92f6-695f14b748ac service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:58:31 user nova-compute[75826]: WARNING nova.compute.manager [req-d2ce1e43-1509-49a8-9ddf-8fd14b8c0e83 req-df2205ff-c0c0-445c-92f6-695f14b748ac service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state active and task_state rescuing.
Nov 16 00:58:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-d2ce1e43-1509-49a8-9ddf-8fd14b8c0e83 req-df2205ff-c0c0-445c-92f6-695f14b748ac service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d2ce1e43-1509-49a8-9ddf-8fd14b8c0e83 req-df2205ff-c0c0-445c-92f6-695f14b748ac service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d2ce1e43-1509-49a8-9ddf-8fd14b8c0e83 req-df2205ff-c0c0-445c-92f6-695f14b748ac service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d2ce1e43-1509-49a8-9ddf-8fd14b8c0e83 req-df2205ff-c0c0-445c-92f6-695f14b748ac service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-d2ce1e43-1509-49a8-9ddf-8fd14b8c0e83 req-df2205ff-c0c0-445c-92f6-695f14b748ac service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:58:31 user nova-compute[75826]: WARNING nova.compute.manager [req-d2ce1e43-1509-49a8-9ddf-8fd14b8c0e83 req-df2205ff-c0c0-445c-92f6-695f14b748ac service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state active and task_state rescuing.
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "da626640-fed0-4b78-a62b-4d946f9e64ea" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG nova.objects.instance [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'flavor' on Instance uuid da626640-fed0-4b78-a62b-4d946f9e64ea {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "da626640-fed0-4b78-a62b-4d946f9e64ea" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:31 user nova-compute[75826]: INFO nova.compute.manager [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Attaching volume 29c1cd41-23b6-484c-b05c-73bc0a7e5a43 to /dev/vdb
Nov 16 00:58:31 user nova-compute[75826]: DEBUG os_brick.utils [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08acf5d-96f2-4e7a-8437-78ad1b952761]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfb9dc8-edd7-4f28-a486-b1a4316c1b76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c0d8ce-742f-49dc-a233-1706f3c39b2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1827e5ec-5453-4348-b9e8-8d52e827e342]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:58:32 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:58:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:32 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:58:32 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:58:32 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e6c459-6c50-4248-beb1-6a7977af27d4]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:32 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:58:32 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:58:32 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:58:32 user nova-compute[75826]: DEBUG os_brick.utils [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:58:32 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Updating existing volume attachment record: 403481cf-5750-4745-a2cb-7072e83b51a8 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:58:32 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6c241402-a12f-48e8-a9a1-f0e60d45a970 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:58:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDGUQXTo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:58:37 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:58:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:58:37 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:58:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:58:37 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[762bbdb6-d4b2-4b6c-9e3a-35e8a6d3a9b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:58:37 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f48424b-99c2-4e5f-bc1b-b38077fe19f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43] added
Nov 16 00:58:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[587739a5-6913-40b5-9813-df4d79012b7d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[78eb8241-4b55-4fef-b7af-6a52f36bafba]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDGUQXTo {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rDGUQXTo" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9454c8-cd78-406b-b345-785f2ce535ac]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rDGUQXTo'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4806fe46-10cc-4f9e-8109-c5a393d71915]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1293c2f6-d0d8-4def-956c-3a8ce8b42cbd]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:58:37 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:58:37 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:58:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:58:37 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:58:37 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:58:37 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:58:37 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --login" returned: 0 in 0.150s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[31021f42-cde6-4695-a6b3-11e0a3964780]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43, portal: 172.16.0.220,3260]
Nov 16 00:58:38 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43, portal: 172.16.0.220,3260] successful.
Nov 16 00:58:38 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a230ca6-2f03-4cb9-9814-30819ee7cfbf]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[38051fae-3607-46b7-b114-a45f474a5a5e]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:58:38 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:58:38 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:58:38 user nova-compute[75826]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 (non-flash)
Nov 16 00:58:38 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:58:38 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:58:38 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:58:38 user nova-compute[75826]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 (non-flash)
Nov 16 00:58:38 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff87eae-7e76-4fcd-a27d-dda3bb213fde]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:58:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDGUQXTo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:58:39 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.428s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:58:39 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] <== connect_volume: return (1430ms) {'type': 'block', 'scsi_wwn': '23134393032383661', 'path': '/dev/sde'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:58:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134393032383661', 'path': '/dev/sde'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:58:39 user nova-compute[75826]: DEBUG nova.objects.instance [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'flavor' on Instance uuid da626640-fed0-4b78-a62b-4d946f9e64ea {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:58:39 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:58:39 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 00:58:39 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:58:39 user nova-compute[75826]:   <serial>29c1cd41-23b6-484c-b05c-73bc0a7e5a43</serial>
Nov 16 00:58:39 user nova-compute[75826]: </disk>
Nov 16 00:58:39 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:58:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:58:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:58:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] No VIF found with MAC fa:16:3e:bd:42:d3, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:58:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-54f3b9ec-d2e3-4928-a12b-0a8d04fb950b tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.927s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "da626640-fed0-4b78-a62b-4d946f9e64ea" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:41 user nova-compute[75826]: INFO nova.compute.manager [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Detaching volume 29c1cd41-23b6-484c-b05c-73bc0a7e5a43
Nov 16 00:58:41 user nova-compute[75826]: INFO nova.virt.block_device [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Attempting to driver detach volume 29c1cd41-23b6-484c-b05c-73bc0a7e5a43 from mountpoint /dev/vdb
Nov 16 00:58:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Attempting to detach device vdb from instance da626640-fed0-4b78-a62b-4d946f9e64ea from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:58:41 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:58:41 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 00:58:41 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:58:41 user nova-compute[75826]:   <serial>29c1cd41-23b6-484c-b05c-73bc0a7e5a43</serial>
Nov 16 00:58:41 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:58:41 user nova-compute[75826]: </disk>
Nov 16 00:58:41 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:58:41 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully detached device vdb from instance da626640-fed0-4b78-a62b-4d946f9e64ea from the persistent domain config.
Nov 16 00:58:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance da626640-fed0-4b78-a62b-4d946f9e64ea from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 00:58:41 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:58:41 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 00:58:41 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:58:41 user nova-compute[75826]:   <serial>29c1cd41-23b6-484c-b05c-73bc0a7e5a43</serial>
Nov 16 00:58:41 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 00:58:41 user nova-compute[75826]: </disk>
Nov 16 00:58:41 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG nova.objects.instance [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'flavor' on Instance uuid 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance da626640-fed0-4b78-a62b-4d946f9e64ea {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:41 user nova-compute[75826]: INFO nova.compute.manager [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Attaching volume 9d194355-7fd2-4919-a590-e78e4e7e4bdb to /dev/vdb
Nov 16 00:58:41 user nova-compute[75826]: DEBUG os_brick.utils [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1384770-a987-466c-8b51-cdaba3c7facd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a79b1b-8a90-480a-95d3-74eb901c2b22]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e97d2fe-f2dd-4214-bea3-737501ecde28]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[562b7fa0-4b22-4ef6-aa1f-62610d860110]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 00:58:41 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 00:58:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7483a2e-1414-43c1-bb62-f17df7d99aa3]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG os_brick.utils [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:58:41 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updating existing volume attachment record: 203c56f8-79a1-4feb-88ad-210b3982bb11 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "13b9b8b9-6ab1-4a8a-853f-00769b543743" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:44 user nova-compute[75826]: INFO nova.compute.manager [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Terminating instance
Nov 16 00:58:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-aeba3669-c71e-4db2-a7a4-bf9f6d87e093 req-5b3e6c4e-2c85-4143-a4d7-8416216ffbc8 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Received event network-vif-unplugged-378f1586-075a-47fc-8723-540896093fe4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-aeba3669-c71e-4db2-a7a4-bf9f6d87e093 req-5b3e6c4e-2c85-4143-a4d7-8416216ffbc8 service nova] Acquiring lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-aeba3669-c71e-4db2-a7a4-bf9f6d87e093 req-5b3e6c4e-2c85-4143-a4d7-8416216ffbc8 service nova] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-aeba3669-c71e-4db2-a7a4-bf9f6d87e093 req-5b3e6c4e-2c85-4143-a4d7-8416216ffbc8 service nova] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-aeba3669-c71e-4db2-a7a4-bf9f6d87e093 req-5b3e6c4e-2c85-4143-a4d7-8416216ffbc8 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] No waiting events found dispatching network-vif-unplugged-378f1586-075a-47fc-8723-540896093fe4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-aeba3669-c71e-4db2-a7a4-bf9f6d87e093 req-5b3e6c4e-2c85-4143-a4d7-8416216ffbc8 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Received event network-vif-unplugged-378f1586-075a-47fc-8723-540896093fe4 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:45 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Instance destroyed successfully.
Nov 16 00:58:45 user nova-compute[75826]: DEBUG nova.objects.instance [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lazy-loading 'resources' on Instance uuid 13b9b8b9-6ab1-4a8a-853f-00769b543743 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:39:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1519462314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1519462314',id=2,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:39:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e45c7fd936b74e109f83fc69060af216',ramdisk_id='',reservation_id='r-0l54ewg2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:41:01Z,user_data=None,user_id='f8606321461c403cbec7f0a36e454bc8',uuid=13b9b8b9-6ab1-4a8a-853f-00769b543743,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "378f1586-075a-47fc-8723-540896093fe4", "address": "fa:16:3e:7d:d3:79", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378f1586-07", "ovs_interfaceid": "378f1586-075a-47fc-8723-540896093fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converting VIF {"id": "378f1586-075a-47fc-8723-540896093fe4", "address": "fa:16:3e:7d:d3:79", "network": {"id": "2941f3cc-ed1d-4657-8015-177b19e1f47c", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-152131705-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e45c7fd936b74e109f83fc69060af216", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap378f1586-07", "ovs_interfaceid": "378f1586-075a-47fc-8723-540896093fe4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d3:79,bridge_name='br-int',has_traffic_filtering=True,id=378f1586-075a-47fc-8723-540896093fe4,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378f1586-07') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG os_vif [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d3:79,bridge_name='br-int',has_traffic_filtering=True,id=378f1586-075a-47fc-8723-540896093fe4,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378f1586-07') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap378f1586-07, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=430146ad-d529-4a78-8d03-959adbaece7b) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:58:45 user nova-compute[75826]: INFO os_vif [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:d3:79,bridge_name='br-int',has_traffic_filtering=True,id=378f1586-075a-47fc-8723-540896093fe4,network=Network(2941f3cc-ed1d-4657-8015-177b19e1f47c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap378f1586-07')
Nov 16 00:58:45 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Deleting instance files /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743_del
Nov 16 00:58:45 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Deletion of /opt/stack/data/nova/instances/13b9b8b9-6ab1-4a8a-853f-00769b543743_del complete
Nov 16 00:58:45 user nova-compute[75826]: INFO nova.compute.manager [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Took 0.79 seconds to destroy the instance on the hypervisor.
Nov 16 00:58:45 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:58:45 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Took 0.56 seconds to deallocate network for instance.
Nov 16 00:58:45 user nova-compute[75826]: DEBUG nova.compute.manager [req-4b480cd9-6103-4169-8086-23a6f5d41b2c req-19bc46e9-2afb-45e9-a0a9-9af06e950bfc service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Received event network-vif-deleted-378f1586-075a-47fc-8723-540896093fe4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:45 user nova-compute[75826]: INFO nova.compute.manager [req-4b480cd9-6103-4169-8086-23a6f5d41b2c req-19bc46e9-2afb-45e9-a0a9-9af06e950bfc service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Neutron deleted interface 378f1586-075a-47fc-8723-540896093fe4; detaching it from the instance and deleting it from the info cache
Nov 16 00:58:45 user nova-compute[75826]: DEBUG nova.network.neutron [req-4b480cd9-6103-4169-8086-23a6f5d41b2c req-19bc46e9-2afb-45e9-a0a9-9af06e950bfc service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG nova.compute.manager [req-4b480cd9-6103-4169-8086-23a6f5d41b2c req-19bc46e9-2afb-45e9-a0a9-9af06e950bfc service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Detach interface failed, port_id=378f1586-075a-47fc-8723-540896093fe4, reason: Instance 13b9b8b9-6ab1-4a8a-853f-00769b543743 could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:46 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:58:46 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:58:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:46 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Deleted allocations for instance 13b9b8b9-6ab1-4a8a-853f-00769b543743
Nov 16 00:58:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-00d07120-0226-49d6-b12e-1d6301410da3 tempest-ServerBootFromVolumeStableRescueTest-1116494461 tempest-ServerBootFromVolumeStableRescueTest-1116494461-project-member] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.841s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-76f3eaaf-19d4-4fbf-b7c5-324b3d68db07 req-b0ea2e81-3293-49c2-9f1d-e0120902b165 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Received event network-vif-plugged-378f1586-075a-47fc-8723-540896093fe4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-76f3eaaf-19d4-4fbf-b7c5-324b3d68db07 req-b0ea2e81-3293-49c2-9f1d-e0120902b165 service nova] Acquiring lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:58:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-76f3eaaf-19d4-4fbf-b7c5-324b3d68db07 req-b0ea2e81-3293-49c2-9f1d-e0120902b165 service nova] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:58:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-76f3eaaf-19d4-4fbf-b7c5-324b3d68db07 req-b0ea2e81-3293-49c2-9f1d-e0120902b165 service nova] Lock "13b9b8b9-6ab1-4a8a-853f-00769b543743-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-76f3eaaf-19d4-4fbf-b7c5-324b3d68db07 req-b0ea2e81-3293-49c2-9f1d-e0120902b165 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] No waiting events found dispatching network-vif-plugged-378f1586-075a-47fc-8723-540896093fe4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:58:46 user nova-compute[75826]: WARNING nova.compute.manager [req-76f3eaaf-19d4-4fbf-b7c5-324b3d68db07 req-b0ea2e81-3293-49c2-9f1d-e0120902b165 service nova] [instance: 13b9b8b9-6ab1-4a8a-853f-00769b543743] Received unexpected event network-vif-plugged-378f1586-075a-47fc-8723-540896093fe4 for instance with vm_state deleted and task_state None.
Nov 16 00:58:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSbPqXKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:58:47 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:58:47 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:58:47 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[da350fae-3806-4888-b0d7-94fdf044178f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:58:47 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[59008cfa-218c-4c92-8dd2-b24f90471ad6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb] added
Nov 16 00:58:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65add97-a686-4ce1-8f45-f77dc7b082ca]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5116ef-5efa-4815-860f-649f63b4771b]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RSbPqXKl {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RSbPqXKl" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d873f70c-4b8b-4a78-90f4-33c0837bd2bc]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RSbPqXKl'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4df1a6f-51f7-49bf-90fe-609198a46347]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3baf78-5e2d-4301-b62c-ce82dc1c2c69]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 (non-flash)
Nov 16 00:58:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 (non-flash)
Nov 16 00:58:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6c4048-32db-46f7-8210-e2663ca39423]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260]
Nov 16 00:58:47 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260] successful.
Nov 16 00:58:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb15b9ff-8f28-498b-927d-78a77ef58bc2]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[76fb9f34-d918-45ff-86ae-c9b7df15b382]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 00:58:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 (non-flash)
Nov 16 00:58:47 user nova-compute[75826]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 00:58:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[265ce62d-4a51-4c00-97be-82d3f3b493ab]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:58:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:58:48 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:58:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSbPqXKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:58:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:58:48 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23836616161323166', 'path': '/dev/sdf'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:58:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836616161323166', 'path': '/dev/sdf'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:58:48 user nova-compute[75826]: DEBUG nova.objects.instance [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'flavor' on Instance uuid 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:58:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 00:58:48 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:58:48 user nova-compute[75826]:   <source dev="/dev/sdf"/>
Nov 16 00:58:48 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 00:58:48 user nova-compute[75826]:   <serial>9d194355-7fd2-4919-a590-e78e4e7e4bdb</serial>
Nov 16 00:58:48 user nova-compute[75826]: </disk>
Nov 16 00:58:48 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 00:58:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:58:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:58:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] No VIF found with MAC fa:16:3e:3b:01:ba, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:58:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e34f8d6-11ce-4273-9067-16c9e1def54e tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.599s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:58:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-2fa262b7-48bb-4268-b495-16ee0c59cfd1 req-b055876b-f66a-490f-b4c8-e9a3d8c12fc1 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-changed-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-2fa262b7-48bb-4268-b495-16ee0c59cfd1 req-b055876b-f66a-490f-b4c8-e9a3d8c12fc1 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Refreshing instance network info cache due to event network-changed-9891b7e5-c4e1-4202-ad4d-adbb33abfac6. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:58:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2fa262b7-48bb-4268-b495-16ee0c59cfd1 req-b055876b-f66a-490f-b4c8-e9a3d8c12fc1 service nova] Acquiring lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:58:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2fa262b7-48bb-4268-b495-16ee0c59cfd1 req-b055876b-f66a-490f-b4c8-e9a3d8c12fc1 service nova] Acquired lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:58:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-2fa262b7-48bb-4268-b495-16ee0c59cfd1 req-b055876b-f66a-490f-b4c8-e9a3d8c12fc1 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Refreshing network info cache for port 9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:58:54 user nova-compute[75826]: DEBUG nova.network.neutron [req-2fa262b7-48bb-4268-b495-16ee0c59cfd1 req-b055876b-f66a-490f-b4c8-e9a3d8c12fc1 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updated VIF entry in instance network info cache for port 9891b7e5-c4e1-4202-ad4d-adbb33abfac6. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:58:54 user nova-compute[75826]: DEBUG nova.network.neutron [req-2fa262b7-48bb-4268-b495-16ee0c59cfd1 req-b055876b-f66a-490f-b4c8-e9a3d8c12fc1 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updating instance_info_cache with network_info: [{"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:58:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2fa262b7-48bb-4268-b495-16ee0c59cfd1 req-b055876b-f66a-490f-b4c8-e9a3d8c12fc1 service nova] Releasing lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:58:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:58:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-800cf7dc-51f8-456b-8e3c-4d6e8583476b req-5e53f2e3-7617-4296-b3ec-47ab8a97c4af service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-changed-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:58:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-800cf7dc-51f8-456b-8e3c-4d6e8583476b req-5e53f2e3-7617-4296-b3ec-47ab8a97c4af service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Refreshing instance network info cache due to event network-changed-9891b7e5-c4e1-4202-ad4d-adbb33abfac6. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:58:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-800cf7dc-51f8-456b-8e3c-4d6e8583476b req-5e53f2e3-7617-4296-b3ec-47ab8a97c4af service nova] Acquiring lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:58:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-800cf7dc-51f8-456b-8e3c-4d6e8583476b req-5e53f2e3-7617-4296-b3ec-47ab8a97c4af service nova] Acquired lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:58:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-800cf7dc-51f8-456b-8e3c-4d6e8583476b req-5e53f2e3-7617-4296-b3ec-47ab8a97c4af service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Refreshing network info cache for port 9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:58:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-800cf7dc-51f8-456b-8e3c-4d6e8583476b req-5e53f2e3-7617-4296-b3ec-47ab8a97c4af service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updated VIF entry in instance network info cache for port 9891b7e5-c4e1-4202-ad4d-adbb33abfac6. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:58:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-800cf7dc-51f8-456b-8e3c-4d6e8583476b req-5e53f2e3-7617-4296-b3ec-47ab8a97c4af service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updating instance_info_cache with network_info: [{"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:58:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-800cf7dc-51f8-456b-8e3c-4d6e8583476b req-5e53f2e3-7617-4296-b3ec-47ab8a97c4af service nova] Releasing lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:58:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:00 user nova-compute[75826]: INFO nova.compute.manager [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Rebooting instance
Nov 16 00:59:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:59:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquired lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:59:00 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG nova.network.neutron [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updating instance_info_cache with network_info: [{"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Releasing lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:01 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance da626640-fed0-4b78-a62b-4d946f9e64ea is timed out.
Nov 16 00:59:01 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully detached device vdb from instance da626640-fed0-4b78-a62b-4d946f9e64ea from the live domain config.
Nov 16 00:59:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rDGUQXTo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:59:01 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-896a8248-e464-4a0f-b628-4c08842ab34a req-cc6e2a02-5156-49d6-bc04-8ace9da67472 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-vif-unplugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-896a8248-e464-4a0f-b628-4c08842ab34a req-cc6e2a02-5156-49d6-bc04-8ace9da67472 service nova] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-896a8248-e464-4a0f-b628-4c08842ab34a req-cc6e2a02-5156-49d6-bc04-8ace9da67472 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-896a8248-e464-4a0f-b628-4c08842ab34a req-cc6e2a02-5156-49d6-bc04-8ace9da67472 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-896a8248-e464-4a0f-b628-4c08842ab34a req-cc6e2a02-5156-49d6-bc04-8ace9da67472 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] No waiting events found dispatching network-vif-unplugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:59:01 user nova-compute[75826]: WARNING nova.compute.manager [req-896a8248-e464-4a0f-b628-4c08842ab34a req-cc6e2a02-5156-49d6-bc04-8ace9da67472 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received unexpected event network-vif-unplugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca4ebdb-3fcc-4c8a-9a38-2e87e18060bd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:59:01 user nova-compute[75826]: No targets found.
Nov 16 00:59:01 user nova-compute[75826]: iSNS:
Nov 16 00:59:01 user nova-compute[75826]: No targets found.
Nov 16 00:59:01 user nova-compute[75826]: STATIC:
Nov 16 00:59:01 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43
Nov 16 00:59:01 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:59:01 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:59:01 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c
Nov 16 00:59:01 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:59:01 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:59:01 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9
Nov 16 00:59:01 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:59:01 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:59:01 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb
Nov 16 00:59:01 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:59:01 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:59:01 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d
Nov 16 00:59:01 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:59:01 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:59:01 user nova-compute[75826]: FIRMWARE:
Nov 16 00:59:01 user nova-compute[75826]: No targets found.
Nov 16 00:59:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:59:01 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:59:01 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4b53c28-f806-42ac-8ff8-99c3ff3718b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[873c0e59-7a84-4ab0-8f77-e482e0102f50]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:59:01 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:59:01 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:59:01 user nova-compute[75826]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 (non-flash)
Nov 16 00:59:01 user nova-compute[75826]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 00:59:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:59:01 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:59:01 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:59:01 user nova-compute[75826]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 (non-flash)
Nov 16 00:59:01 user nova-compute[75826]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 00:59:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd942cbf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43'): ({'sde'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Removing single pathed devices sde {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac8fa1c-5942-46c7-ae9d-81462d504225]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4f3289-7707-4a9f-8c34-c485fa8476c6]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Flushing IO for device /dev/sde {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c3a2a8-3747-452a-816e-479ff4defe0c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f560cd0b-2fd4-4aa6-8f34-80b2d5f12d83]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[336fe688-5197-4066-ac34-b881cbe5c3a2]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2137ca-530c-44c4-ba5c-0dd7629b3177]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43, portal: 172.16.0.220,3260]
Nov 16 00:59:01 user nova-compute[75826]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43, portal: 172.16.0.220,3260] successful.
Nov 16 00:59:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:29c1cd41-23b6-484c-b05c-73bc0a7e5a43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[873a0226-7817-40a8-a814-df6d97d7131e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] <== disconnect_volume: return (375ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:59:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:59:02 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Instance destroyed successfully.
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'resources' on Instance uuid 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1390751704',display_name='tempest-TestMinimumBasicScenario-server-1390751704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1390751704',id=40,image_ref='de6c5cc5-005e-4fa8-9f5c-0acdff3eff50',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATszQpf97mXvPlPMw/Rcc7WhBJ8KfZflmFA/U/Qg15g3XxUIQBYedZJpwanKi7hNjXnDRb2dFKDFdA95Wcw9faV3VBX1hlc/s/P57pKnmvXD8ZiGwotD10hBdKtZrIgcw==',key_name='tempest-TestMinimumBasicScenario-1740530434',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:56:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fa5ce9593fc4a4ea55228dd113781f1',ramdisk_id='',reservation_id='r-2e83hvx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='de6c5cc5-005e-4fa8-9f5c-0acdff3eff50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1996581904',owner_user_name='tempest-TestMinimumBasicScenario-1996581904-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:59:01Z,user_data=None,user_id='64aa8a18510d4d56b341f56cf8d5d3dd',uuid=9fe77732-86b7-4e9e-ac07-0eef8f9d1405,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converting VIF {"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_vif [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9891b7e5-c4, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=277a9d7e-fa55-44fc-bbbb-ba8d4b9c9894) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:02 user nova-compute[75826]: INFO os_vif [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4')
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSbPqXKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:59:02 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[691689a7-79b9-4bf7-a55f-5ff7fbcac253]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:59:02 user nova-compute[75826]: No targets found.
Nov 16 00:59:02 user nova-compute[75826]: iSNS:
Nov 16 00:59:02 user nova-compute[75826]: No targets found.
Nov 16 00:59:02 user nova-compute[75826]: STATIC:
Nov 16 00:59:02 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c
Nov 16 00:59:02 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:59:02 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:59:02 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9
Nov 16 00:59:02 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:59:02 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:59:02 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb
Nov 16 00:59:02 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:59:02 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:59:02 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d
Nov 16 00:59:02 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:59:02 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:59:02 user nova-compute[75826]: FIRMWARE:
Nov 16 00:59:02 user nova-compute[75826]: No targets found.
Nov 16 00:59:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:59:02 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:59:02 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02bda1f-7845-4982-8784-cbafa06464f6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7752241d-d6bd-4c02-aa6a-6f9b377a08fd]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 00:59:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 00:59:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd9435a4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb'): ({'sdf'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Removing single pathed devices sdf {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca9bcba-0980-4194-b771-4def4d1a5a6a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2698763d-e454-4d57-a78b-07e6961957f9]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Flushing IO for device /dev/sdf {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb355912-a251-4763-8e29-56b210210b42]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[65ccc1f1-efc2-4535-bd35-75f7e328c054]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] SCSI volumes sdf have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[55285fe9-4e09-423d-8ee8-d5188e2821fa]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[947d3870-212c-4cf2-9533-0af33d0db6e2]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260]
Nov 16 00:59:02 user nova-compute[75826]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260] successful.
Nov 16 00:59:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3596839-75a4-4a2f-a7f0-b9acad6b073d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] <== disconnect_volume: return (337ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Start _get_guest_xml network_info=[{"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=de6c5cc5-005e-4fa8-9f5c-0acdff3eff50,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': 'de6c5cc5-005e-4fa8-9f5c-0acdff3eff50'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '203c56f8-79a1-4feb-88ad-210b3982bb11', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSbPqXKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '9fe77732-86b7-4e9e-ac07-0eef8f9d1405', 'attached_at': '', 'detached_at': '', 'volume_id': '9d194355-7fd2-4919-a590-e78e4e7e4bdb', 'serial': '9d194355-7fd2-4919-a590-e78e4e7e4bdb'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:59:02 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:59:02 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=de6c5cc5-005e-4fa8-9f5c-0acdff3eff50,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.objects.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Object Instance<9fe77732-86b7-4e9e-ac07-0eef8f9d1405> lazy-loaded attributes: resources,vcpu_model {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSbPqXKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:59:02 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:59:02 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:59:02 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9195774a-4f33-4e7d-85a4-584b31ebcc82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 00:59:02 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b007d5-e5f0-47d9-b402-93e7f5c72e98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb] added
Nov 16 00:59:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1160e8-5127-4240-96b3-8953f7061633]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6245da-0eb5-41df-82dc-77731d7abf73]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RSbPqXKl {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'flavor' on Instance uuid da626640-fed0-4b78-a62b-4d946f9e64ea {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RSbPqXKl" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[232bebe2-0257-4a66-9b68-f8ca750f7a61]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RSbPqXKl'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aea98e2-d418-4e16-a55d-52757401203e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6c9af2ee-89a0-4ca6-8086-47a865ae702e tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.785s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c989ccba-089e-42c0-b65f-3bcafa10b5ee]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:59:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:59:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[335aed77-f8f5-4c04-8e2a-326af5eaaca6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260]
Nov 16 00:59:02 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260] successful.
Nov 16 00:59:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0562be1-2f6d-4c52-b902-610a280b8ce6]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8728490-22bf-4374-ad35-33f836bfc930]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 00:59:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:59:02 user nova-compute[75826]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 00:59:02 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] HCTL ('36', '-', '-', 0) found on session 47 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e179d61c-dcbb-4634-9f7d-c920be97cd8c]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:02 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:59:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-59d6c8c2-b9fd-4b50-a081-7391211a1bb3 req-00e318f9-c8f4-41d7-ab06-11f01e3970ae service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-59d6c8c2-b9fd-4b50-a081-7391211a1bb3 req-00e318f9-c8f4-41d7-ab06-11f01e3970ae service nova] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-59d6c8c2-b9fd-4b50-a081-7391211a1bb3 req-00e318f9-c8f4-41d7-ab06-11f01e3970ae service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-59d6c8c2-b9fd-4b50-a081-7391211a1bb3 req-00e318f9-c8f4-41d7-ab06-11f01e3970ae service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-59d6c8c2-b9fd-4b50-a081-7391211a1bb3 req-00e318f9-c8f4-41d7-ab06-11f01e3970ae service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] No waiting events found dispatching network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:59:03 user nova-compute[75826]: WARNING nova.compute.manager [req-59d6c8c2-b9fd-4b50-a081-7391211a1bb3 req-00e318f9-c8f4-41d7-ab06-11f01e3970ae service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received unexpected event network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 00:59:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Searching for a device in session 47 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 00:59:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSbPqXKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 00:59:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:59:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23836616161323166', 'path': '/dev/sde'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:59:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23836616161323166', 'path': '/dev/sde'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 00:59:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1390751704',display_name='tempest-TestMinimumBasicScenario-server-1390751704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1390751704',id=40,image_ref='de6c5cc5-005e-4fa8-9f5c-0acdff3eff50',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATszQpf97mXvPlPMw/Rcc7WhBJ8KfZflmFA/U/Qg15g3XxUIQBYedZJpwanKi7hNjXnDRb2dFKDFdA95Wcw9faV3VBX1hlc/s/P57pKnmvXD8ZiGwotD10hBdKtZrIgcw==',key_name='tempest-TestMinimumBasicScenario-1740530434',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:56:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fa5ce9593fc4a4ea55228dd113781f1',ramdisk_id='',reservation_id='r-2e83hvx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='de6c5cc5-005e-4fa8-9f5c-0acdff3eff50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1996581904',owner_user_name='tempest-TestMinimumBasicScenario-1996581904-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:59:01Z,user_data=None,user_id='64aa8a18510d4d56b341f56cf8d5d3dd',uuid=9fe77732-86b7-4e9e-ac07-0eef8f9d1405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:59:03 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converting VIF {"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:59:03 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:59:03 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'pci_devices' on Instance uuid 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG nova.objects.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Object Instance<9fe77732-86b7-4e9e-ac07-0eef8f9d1405> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:59:04 user nova-compute[75826]:   <uuid>9fe77732-86b7-4e9e-ac07-0eef8f9d1405</uuid>
Nov 16 00:59:04 user nova-compute[75826]:   <name>instance-00000028</name>
Nov 16 00:59:04 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:59:04 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:59:04 user nova-compute[75826]:   <metadata>
Nov 16 00:59:04 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:59:04 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:59:04 user nova-compute[75826]:       <nova:name>tempest-TestMinimumBasicScenario-server-1390751704</nova:name>
Nov 16 00:59:04 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:59:02</nova:creationTime>
Nov 16 00:59:04 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:59:04 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:59:04 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:59:04 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:59:04 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:59:04 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:59:04 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:59:04 user nova-compute[75826]:       <nova:owner>
Nov 16 00:59:04 user nova-compute[75826]:         <nova:user uuid="64aa8a18510d4d56b341f56cf8d5d3dd">tempest-TestMinimumBasicScenario-1996581904-project-member</nova:user>
Nov 16 00:59:04 user nova-compute[75826]:         <nova:project uuid="9fa5ce9593fc4a4ea55228dd113781f1">tempest-TestMinimumBasicScenario-1996581904</nova:project>
Nov 16 00:59:04 user nova-compute[75826]:       </nova:owner>
Nov 16 00:59:04 user nova-compute[75826]:       <nova:root type="image" uuid="de6c5cc5-005e-4fa8-9f5c-0acdff3eff50"/>
Nov 16 00:59:04 user nova-compute[75826]:       <nova:ports>
Nov 16 00:59:04 user nova-compute[75826]:         <nova:port uuid="9891b7e5-c4e1-4202-ad4d-adbb33abfac6">
Nov 16 00:59:04 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 16 00:59:04 user nova-compute[75826]:         </nova:port>
Nov 16 00:59:04 user nova-compute[75826]:       </nova:ports>
Nov 16 00:59:04 user nova-compute[75826]:     </nova:instance>
Nov 16 00:59:04 user nova-compute[75826]:   </metadata>
Nov 16 00:59:04 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:59:04 user nova-compute[75826]:     <system>
Nov 16 00:59:04 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:59:04 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:59:04 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:59:04 user nova-compute[75826]:       <entry name="serial">9fe77732-86b7-4e9e-ac07-0eef8f9d1405</entry>
Nov 16 00:59:04 user nova-compute[75826]:       <entry name="uuid">9fe77732-86b7-4e9e-ac07-0eef8f9d1405</entry>
Nov 16 00:59:04 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:59:04 user nova-compute[75826]:     </system>
Nov 16 00:59:04 user nova-compute[75826]:   </sysinfo>
Nov 16 00:59:04 user nova-compute[75826]:   <os>
Nov 16 00:59:04 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:59:04 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:59:04 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:59:04 user nova-compute[75826]:   </os>
Nov 16 00:59:04 user nova-compute[75826]:   <features>
Nov 16 00:59:04 user nova-compute[75826]:     <acpi/>
Nov 16 00:59:04 user nova-compute[75826]:     <apic/>
Nov 16 00:59:04 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:59:04 user nova-compute[75826]:   </features>
Nov 16 00:59:04 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:59:04 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:59:04 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:59:04 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:59:04 user nova-compute[75826]:   </clock>
Nov 16 00:59:04 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:59:04 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:59:04 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:59:04 user nova-compute[75826]:   </cpu>
Nov 16 00:59:04 user nova-compute[75826]:   <devices>
Nov 16 00:59:04 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:59:04 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:59:04 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk"/>
Nov 16 00:59:04 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:59:04 user nova-compute[75826]:     </disk>
Nov 16 00:59:04 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 00:59:04 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 00:59:04 user nova-compute[75826]:       <source dev="/dev/sde"/>
Nov 16 00:59:04 user nova-compute[75826]:       <target dev="vdb" bus="virtio"/>
Nov 16 00:59:04 user nova-compute[75826]:       <serial>9d194355-7fd2-4919-a590-e78e4e7e4bdb</serial>
Nov 16 00:59:04 user nova-compute[75826]:     </disk>
Nov 16 00:59:04 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:59:04 user nova-compute[75826]:       <mac address="fa:16:3e:3b:01:ba"/>
Nov 16 00:59:04 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:59:04 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:59:04 user nova-compute[75826]:       <target dev="tap9891b7e5-c4"/>
Nov 16 00:59:04 user nova-compute[75826]:     </interface>
Nov 16 00:59:04 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:59:04 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/console.log" append="off"/>
Nov 16 00:59:04 user nova-compute[75826]:     </serial>
Nov 16 00:59:04 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:59:04 user nova-compute[75826]:     <video>
Nov 16 00:59:04 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:59:04 user nova-compute[75826]:     </video>
Nov 16 00:59:04 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:59:04 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:59:04 user nova-compute[75826]:     </rng>
Nov 16 00:59:04 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:59:04 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:59:04 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:59:04 user nova-compute[75826]:     </memballoon>
Nov 16 00:59:04 user nova-compute[75826]:   </devices>
Nov 16 00:59:04 user nova-compute[75826]: </domain>
Nov 16 00:59:04 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG nova.objects.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Object Instance<9fe77732-86b7-4e9e-ac07-0eef8f9d1405> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992 --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992 --force-share --output=json" returned: 0 in 0.205s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Cannot resize image /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'migration_context' on Instance uuid 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG nova.objects.base [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Object Instance<9fe77732-86b7-4e9e-ac07-0eef8f9d1405> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1390751704',display_name='tempest-TestMinimumBasicScenario-server-1390751704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1390751704',id=40,image_ref='de6c5cc5-005e-4fa8-9f5c-0acdff3eff50',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATszQpf97mXvPlPMw/Rcc7WhBJ8KfZflmFA/U/Qg15g3XxUIQBYedZJpwanKi7hNjXnDRb2dFKDFdA95Wcw9faV3VBX1hlc/s/P57pKnmvXD8ZiGwotD10hBdKtZrIgcw==',key_name='tempest-TestMinimumBasicScenario-1740530434',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:56:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='9fa5ce9593fc4a4ea55228dd113781f1',ramdisk_id='',reservation_id='r-2e83hvx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='de6c5cc5-005e-4fa8-9f5c-0acdff3eff50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1996581904',owner_user_name='tempest-TestMinimumBasicScenario-1996581904-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:59:01Z,user_data=None,user_id='64aa8a18510d4d56b341f56cf8d5d3dd',uuid=9fe77732-86b7-4e9e-ac07-0eef8f9d1405,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converting VIF {"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG os_vif [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b840eda4-d749-5c0a-b71a-46cbbbcba13e', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9891b7e5-c4, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9891b7e5-c4, col_values=(('qos', UUID('78211598-9a5f-42f5-ad1f-f8f6281ef835')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9891b7e5-c4, col_values=(('external_ids', {'iface-id': '9891b7e5-c4e1-4202-ad4d-adbb33abfac6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:01:ba', 'vm-uuid': '9fe77732-86b7-4e9e-ac07-0eef8f9d1405'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:04 user nova-compute[75826]: INFO os_vif [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4')
Nov 16 00:59:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-2ff49a85-acaf-41f0-a0f5-23d325122ba2 req-5de29328-dda1-472b-82e6-d85c8db5d7e6 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2ff49a85-acaf-41f0-a0f5-23d325122ba2 req-5de29328-dda1-472b-82e6-d85c8db5d7e6 service nova] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2ff49a85-acaf-41f0-a0f5-23d325122ba2 req-5de29328-dda1-472b-82e6-d85c8db5d7e6 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2ff49a85-acaf-41f0-a0f5-23d325122ba2 req-5de29328-dda1-472b-82e6-d85c8db5d7e6 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-2ff49a85-acaf-41f0-a0f5-23d325122ba2 req-5de29328-dda1-472b-82e6-d85c8db5d7e6 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] No waiting events found dispatching network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:59:06 user nova-compute[75826]: WARNING nova.compute.manager [req-2ff49a85-acaf-41f0-a0f5-23d325122ba2 req-5de29328-dda1-472b-82e6-d85c8db5d7e6 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received unexpected event network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 00:59:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:08 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:59:08 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Instance rebooted successfully.
Nov 16 00:59:08 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:59:08 user nova-compute[75826]: DEBUG nova.compute.manager [req-f5d3554b-7adb-4acd-a322-67e5c5eca7c9 req-cdac1960-a2f7-4160-a717-b7ea220a31a1 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f5d3554b-7adb-4acd-a322-67e5c5eca7c9 req-cdac1960-a2f7-4160-a717-b7ea220a31a1 service nova] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f5d3554b-7adb-4acd-a322-67e5c5eca7c9 req-cdac1960-a2f7-4160-a717-b7ea220a31a1 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f5d3554b-7adb-4acd-a322-67e5c5eca7c9 req-cdac1960-a2f7-4160-a717-b7ea220a31a1 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:08 user nova-compute[75826]: DEBUG nova.compute.manager [req-f5d3554b-7adb-4acd-a322-67e5c5eca7c9 req-cdac1960-a2f7-4160-a717-b7ea220a31a1 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] No waiting events found dispatching network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:59:08 user nova-compute[75826]: WARNING nova.compute.manager [req-f5d3554b-7adb-4acd-a322-67e5c5eca7c9 req-cdac1960-a2f7-4160-a717-b7ea220a31a1 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received unexpected event network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 for instance with vm_state active and task_state reboot_started_hard.
Nov 16 00:59:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6ac5af8a-cf3c-46d7-a616-a7aa0d3539b7 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.151s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:09 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:59:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 00:59:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 00:59:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:59:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:59:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 00:59:09 user nova-compute[75826]: DEBUG nova.objects.instance [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lazy-loading 'info_cache' on Instance uuid 574817b0-a25c-4da1-9ce6-804008e8279c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:59:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Updating instance_info_cache with network_info: [{"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:59:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:59:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 00:59:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:10 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:59:12 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:59:12 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:59:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:12 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 00:59:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:59:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:59:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:59:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 00:59:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:15 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:59:15 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:59:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=8090MB free_disk=25.258262634277344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance f2aeb101-4454-4a86-9e77-9426c732d526 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance da626640-fed0-4b78-a62b-4d946f9e64ea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 9f9e020d-2ebf-4ea4-bc70-cac80f34643f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 00:59:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:18 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:59:18 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:59:18 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:59:19 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:59:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 00:59:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:59:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 00:59:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:59:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 00:59:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:23 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:59:24 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 00:59:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-7f2a1c02-4a9c-4ce0-8826-dc3f5ba55cba req-587d8a49-e59b-4d2b-b4fe-6381c351ef78 service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Received event network-changed-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-7f2a1c02-4a9c-4ce0-8826-dc3f5ba55cba req-587d8a49-e59b-4d2b-b4fe-6381c351ef78 service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Refreshing instance network info cache due to event network-changed-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:59:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7f2a1c02-4a9c-4ce0-8826-dc3f5ba55cba req-587d8a49-e59b-4d2b-b4fe-6381c351ef78 service nova] Acquiring lock "refresh_cache-9f9e020d-2ebf-4ea4-bc70-cac80f34643f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:59:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7f2a1c02-4a9c-4ce0-8826-dc3f5ba55cba req-587d8a49-e59b-4d2b-b4fe-6381c351ef78 service nova] Acquired lock "refresh_cache-9f9e020d-2ebf-4ea4-bc70-cac80f34643f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:59:25 user nova-compute[75826]: DEBUG nova.network.neutron [req-7f2a1c02-4a9c-4ce0-8826-dc3f5ba55cba req-587d8a49-e59b-4d2b-b4fe-6381c351ef78 service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Refreshing network info cache for port 6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:26 user nova-compute[75826]: INFO nova.compute.manager [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Terminating instance
Nov 16 00:59:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG nova.network.neutron [req-7f2a1c02-4a9c-4ce0-8826-dc3f5ba55cba req-587d8a49-e59b-4d2b-b4fe-6381c351ef78 service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Updated VIF entry in instance network info cache for port 6afaf936-ebb9-4eac-a1cc-89ee3f9dae65. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG nova.network.neutron [req-7f2a1c02-4a9c-4ce0-8826-dc3f5ba55cba req-587d8a49-e59b-4d2b-b4fe-6381c351ef78 service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Updating instance_info_cache with network_info: [{"id": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "address": "fa:16:3e:69:c8:f9", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.153", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf936-eb", "ovs_interfaceid": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7f2a1c02-4a9c-4ce0-8826-dc3f5ba55cba req-587d8a49-e59b-4d2b-b4fe-6381c351ef78 service nova] Releasing lock "refresh_cache-9f9e020d-2ebf-4ea4-bc70-cac80f34643f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-7b5605b3-fbf9-4668-ad96-24fcd27c5789 req-9cec684a-0a06-4a9c-b628-9f64c0bf2c8c service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Received event network-vif-unplugged-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7b5605b3-fbf9-4668-ad96-24fcd27c5789 req-9cec684a-0a06-4a9c-b628-9f64c0bf2c8c service nova] Acquiring lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7b5605b3-fbf9-4668-ad96-24fcd27c5789 req-9cec684a-0a06-4a9c-b628-9f64c0bf2c8c service nova] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7b5605b3-fbf9-4668-ad96-24fcd27c5789 req-9cec684a-0a06-4a9c-b628-9f64c0bf2c8c service nova] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-7b5605b3-fbf9-4668-ad96-24fcd27c5789 req-9cec684a-0a06-4a9c-b628-9f64c0bf2c8c service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] No waiting events found dispatching network-vif-unplugged-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-7b5605b3-fbf9-4668-ad96-24fcd27c5789 req-9cec684a-0a06-4a9c-b628-9f64c0bf2c8c service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Received event network-vif-unplugged-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:59:26 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Instance destroyed successfully.
Nov 16 00:59:26 user nova-compute[75826]: DEBUG nova.objects.instance [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lazy-loading 'resources' on Instance uuid 9f9e020d-2ebf-4ea4-bc70-cac80f34643f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:57:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1587900635',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1587900635',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1587900635',id=41,image_ref='5d20c58c-e049-4d5b-ad36-885d062deb42',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInrK3DsPJNTVikdUNHecFcuY1iMYQFpCvUXewQrfbWZvFc9gCZPPCPNvBNN8MflUI7yjB6Z0OLSrZJnTS3nNmE6GBqiwpf4S9Z+H0efVSYt/5uEjnQCMKdNxXNNP0C4Ow==',key_name='tempest-keypair-1806925161',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:57:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-4amzkebp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-2108626012',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:57:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c17265442bc48f9b6de5367e91096b2',uuid=9f9e020d-2ebf-4ea4-bc70-cac80f34643f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "address": "fa:16:3e:69:c8:f9", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf936-eb", "ovs_interfaceid": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "address": "fa:16:3e:69:c8:f9", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6afaf936-eb", "ovs_interfaceid": "6afaf936-ebb9-4eac-a1cc-89ee3f9dae65", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=6afaf936-ebb9-4eac-a1cc-89ee3f9dae65,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf936-eb') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG os_vif [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=6afaf936-ebb9-4eac-a1cc-89ee3f9dae65,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf936-eb') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6afaf936-eb, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=df829e68-0176-4f38-805b-ec01291775fe) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:59:27 user nova-compute[75826]: INFO os_vif [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=6afaf936-ebb9-4eac-a1cc-89ee3f9dae65,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6afaf936-eb')
Nov 16 00:59:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XiTOgWtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 00:59:27 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f8d102-3976-4ea5-8b39-8e9cdba9ecfe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 00:59:27 user nova-compute[75826]: No targets found.
Nov 16 00:59:27 user nova-compute[75826]: iSNS:
Nov 16 00:59:27 user nova-compute[75826]: No targets found.
Nov 16 00:59:27 user nova-compute[75826]: STATIC:
Nov 16 00:59:27 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c
Nov 16 00:59:27 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:59:27 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:59:27 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9
Nov 16 00:59:27 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:59:27 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:59:27 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb
Nov 16 00:59:27 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:59:27 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:59:27 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d
Nov 16 00:59:27 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 00:59:27 user nova-compute[75826]:                 Iface Name: default
Nov 16 00:59:27 user nova-compute[75826]: FIRMWARE:
Nov 16 00:59:27 user nova-compute[75826]: No targets found.
Nov 16 00:59:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 00:59:27 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 00:59:27 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2295c5e-343e-4f89-ad63-c18113310e60]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee5d6c3-da3c-4ada-9d13-fb2a2dcb599e]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:59:27 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:59:27 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:59:27 user nova-compute[75826]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 00:59:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 00:59:27 user nova-compute[75826]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c (non-flash)
Nov 16 00:59:27 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 00:59:27 user nova-compute[75826]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 00:59:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd9435ab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c'): ({'sdc'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Removing single pathed devices sdc {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7943cff8-1809-4469-8abb-e0ba36fa3d73]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eae51c9-2a54-4e92-b2d7-1f3fe984c2aa]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flushing IO for device /dev/sdc {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24599f6-3547-4cb3-8977-3f1ed3f0222c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8807f3-83d9-4de2-b6b6-7837f4e3cff9]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9268ae0-5165-4095-94da-f76db96abb15]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f9e8d8-8af5-479b-9488-ddaa28f3cba2]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c, portal: 172.16.0.220,3260]
Nov 16 00:59:27 user nova-compute[75826]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c, portal: 172.16.0.220,3260] successful.
Nov 16 00:59:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eed8e09-4b8f-4161-96e7-1a9bd06ca71c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbfbe97-69ae-4593-8023-ee005cae18a0]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== disconnect_volume: return (345ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 00:59:27 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Deleting instance files /opt/stack/data/nova/instances/9f9e020d-2ebf-4ea4-bc70-cac80f34643f_del
Nov 16 00:59:27 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Deletion of /opt/stack/data/nova/instances/9f9e020d-2ebf-4ea4-bc70-cac80f34643f_del complete
Nov 16 00:59:27 user nova-compute[75826]: INFO nova.compute.manager [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Took 1.35 seconds to destroy the instance on the hypervisor.
Nov 16 00:59:27 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:59:27 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:59:28 user nova-compute[75826]: DEBUG nova.compute.manager [req-b81029e8-d8e2-4d05-8471-88d0377df054 req-089661cc-d36f-453c-8ed0-f06e97a8892d service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Received event network-vif-plugged-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b81029e8-d8e2-4d05-8471-88d0377df054 req-089661cc-d36f-453c-8ed0-f06e97a8892d service nova] Acquiring lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b81029e8-d8e2-4d05-8471-88d0377df054 req-089661cc-d36f-453c-8ed0-f06e97a8892d service nova] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b81029e8-d8e2-4d05-8471-88d0377df054 req-089661cc-d36f-453c-8ed0-f06e97a8892d service nova] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:28 user nova-compute[75826]: DEBUG nova.compute.manager [req-b81029e8-d8e2-4d05-8471-88d0377df054 req-089661cc-d36f-453c-8ed0-f06e97a8892d service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] No waiting events found dispatching network-vif-plugged-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:59:28 user nova-compute[75826]: WARNING nova.compute.manager [req-b81029e8-d8e2-4d05-8471-88d0377df054 req-089661cc-d36f-453c-8ed0-f06e97a8892d service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Received unexpected event network-vif-plugged-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 for instance with vm_state active and task_state deleting.
Nov 16 00:59:28 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:59:28 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Took 1.11 seconds to deallocate network for instance.
Nov 16 00:59:28 user nova-compute[75826]: DEBUG nova.compute.manager [req-d282eba3-687e-435d-8b8d-d36b897883b7 req-3ee7dc11-735c-49d0-bc13-a45457af9145 service nova] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Received event network-vif-deleted-6afaf936-ebb9-4eac-a1cc-89ee3f9dae65 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:29 user nova-compute[75826]: INFO nova.compute.manager [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Took 0.73 seconds to detach 1 volumes for instance.
Nov 16 00:59:29 user nova-compute[75826]: DEBUG nova.compute.manager [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 9f9e020d-2ebf-4ea4-bc70-cac80f34643f] Deleting volume: 3eed8e09-4b8f-4161-96e7-1a9bd06ca71c {{(pid=75826) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 00:59:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:29 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:59:29 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:59:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:29 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Deleted allocations for instance 9f9e020d-2ebf-4ea4-bc70-cac80f34643f
Nov 16 00:59:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-941f7428-5e32-408b-b601-2ae4e0af9bd0 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "9f9e020d-2ebf-4ea4-bc70-cac80f34643f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.832s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "da626640-fed0-4b78-a62b-4d946f9e64ea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:31 user nova-compute[75826]: INFO nova.compute.manager [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Terminating instance
Nov 16 00:59:31 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-98ce43f2-9c83-481f-8b70-9ffec352547b req-04497f04-8e9a-42f3-b9f7-8c932fc6b726 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Received event network-vif-unplugged-ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-98ce43f2-9c83-481f-8b70-9ffec352547b req-04497f04-8e9a-42f3-b9f7-8c932fc6b726 service nova] Acquiring lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-98ce43f2-9c83-481f-8b70-9ffec352547b req-04497f04-8e9a-42f3-b9f7-8c932fc6b726 service nova] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-98ce43f2-9c83-481f-8b70-9ffec352547b req-04497f04-8e9a-42f3-b9f7-8c932fc6b726 service nova] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-98ce43f2-9c83-481f-8b70-9ffec352547b req-04497f04-8e9a-42f3-b9f7-8c932fc6b726 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] No waiting events found dispatching network-vif-unplugged-ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:59:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-98ce43f2-9c83-481f-8b70-9ffec352547b req-04497f04-8e9a-42f3-b9f7-8c932fc6b726 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Received event network-vif-unplugged-ca0853d2-3703-40f3-970e-b64dae00d399 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:32 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Instance destroyed successfully.
Nov 16 00:59:32 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lazy-loading 'resources' on Instance uuid da626640-fed0-4b78-a62b-4d946f9e64ea {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:56:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-963837593',display_name='tempest-AttachVolumeNegativeTest-server-963837593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-963837593',id=39,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5WXmTqZV7QuDCW2C3ly/rXAB1Vk2gyF7B30BBmr66Ieq/Q9JBwHlcG4AzQRH8RZ0HXNF5dXnVonI2+HbwWixXegqEqAoPk95Bl9yaT6Ltqv7mUDBU+auL8NvSpKEdtvA==',key_name='tempest-keypair-744156524',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:56:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='13ad3ee3a8e04d728243e886a1460cae',ramdisk_id='',reservation_id='r-szp0w7lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-471555798',owner_user_name='tempest-AttachVolumeNegativeTest-471555798-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:56:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e2d1a7cea414446842b5abfc9fe93de',uuid=da626640-fed0-4b78-a62b-4d946f9e64ea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca0853d2-3703-40f3-970e-b64dae00d399", "address": "fa:16:3e:bd:42:d3", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0853d2-37", "ovs_interfaceid": "ca0853d2-3703-40f3-970e-b64dae00d399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converting VIF {"id": "ca0853d2-3703-40f3-970e-b64dae00d399", "address": "fa:16:3e:bd:42:d3", "network": {"id": "eaefa8ec-b158-4174-abf8-20f2dc90da68", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1705049508-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "13ad3ee3a8e04d728243e886a1460cae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca0853d2-37", "ovs_interfaceid": "ca0853d2-3703-40f3-970e-b64dae00d399", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bd:42:d3,bridge_name='br-int',has_traffic_filtering=True,id=ca0853d2-3703-40f3-970e-b64dae00d399,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0853d2-37') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG os_vif [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:42:d3,bridge_name='br-int',has_traffic_filtering=True,id=ca0853d2-3703-40f3-970e-b64dae00d399,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0853d2-37') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca0853d2-37, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5b3b71f-ec9f-481c-8552-b0028b66f6ba) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:32 user nova-compute[75826]: INFO os_vif [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bd:42:d3,bridge_name='br-int',has_traffic_filtering=True,id=ca0853d2-3703-40f3-970e-b64dae00d399,network=Network(eaefa8ec-b158-4174-abf8-20f2dc90da68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca0853d2-37')
Nov 16 00:59:32 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Deleting instance files /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea_del
Nov 16 00:59:32 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Deletion of /opt/stack/data/nova/instances/da626640-fed0-4b78-a62b-4d946f9e64ea_del complete
Nov 16 00:59:32 user nova-compute[75826]: INFO nova.compute.manager [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 00:59:32 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 00:59:32 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 00:59:33 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:59:33 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Took 0.82 seconds to deallocate network for instance.
Nov 16 00:59:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-4154cf7d-9597-474e-91d5-36f63929cec6 req-3f0ae948-2219-43e3-90fc-a7dbb70b63d7 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Received event network-vif-deleted-ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:33 user nova-compute[75826]: INFO nova.compute.manager [req-4154cf7d-9597-474e-91d5-36f63929cec6 req-3f0ae948-2219-43e3-90fc-a7dbb70b63d7 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Neutron deleted interface ca0853d2-3703-40f3-970e-b64dae00d399; detaching it from the instance and deleting it from the info cache
Nov 16 00:59:33 user nova-compute[75826]: DEBUG nova.network.neutron [req-4154cf7d-9597-474e-91d5-36f63929cec6 req-3f0ae948-2219-43e3-90fc-a7dbb70b63d7 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:59:33 user nova-compute[75826]: DEBUG nova.compute.manager [req-4154cf7d-9597-474e-91d5-36f63929cec6 req-3f0ae948-2219-43e3-90fc-a7dbb70b63d7 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Detach interface failed, port_id=ca0853d2-3703-40f3-970e-b64dae00d399, reason: Instance da626640-fed0-4b78-a62b-4d946f9e64ea could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 00:59:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:33 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:59:33 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:59:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.620s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:33 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Deleted allocations for instance da626640-fed0-4b78-a62b-4d946f9e64ea
Nov 16 00:59:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4faa0ef2-7173-4923-b520-6871e48588b0 tempest-AttachVolumeNegativeTest-471555798 tempest-AttachVolumeNegativeTest-471555798-project-member] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.641s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-7f91733c-c3a9-49e0-9535-21a2939ecdda req-20e02bc9-8d17-4254-b0d9-a60cd1d32f93 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Received event network-vif-plugged-ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7f91733c-c3a9-49e0-9535-21a2939ecdda req-20e02bc9-8d17-4254-b0d9-a60cd1d32f93 service nova] Acquiring lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7f91733c-c3a9-49e0-9535-21a2939ecdda req-20e02bc9-8d17-4254-b0d9-a60cd1d32f93 service nova] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7f91733c-c3a9-49e0-9535-21a2939ecdda req-20e02bc9-8d17-4254-b0d9-a60cd1d32f93 service nova] Lock "da626640-fed0-4b78-a62b-4d946f9e64ea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-7f91733c-c3a9-49e0-9535-21a2939ecdda req-20e02bc9-8d17-4254-b0d9-a60cd1d32f93 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] No waiting events found dispatching network-vif-plugged-ca0853d2-3703-40f3-970e-b64dae00d399 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:59:34 user nova-compute[75826]: WARNING nova.compute.manager [req-7f91733c-c3a9-49e0-9535-21a2939ecdda req-20e02bc9-8d17-4254-b0d9-a60cd1d32f93 service nova] [instance: da626640-fed0-4b78-a62b-4d946f9e64ea] Received unexpected event network-vif-plugged-ca0853d2-3703-40f3-970e-b64dae00d399 for instance with vm_state deleted and task_state None.
Nov 16 00:59:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:59:51 user nova-compute[75826]: INFO nova.compute.claims [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Claim successful on node user
Nov 16 00:59:51 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.356s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:59:51 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:59:51 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG nova.policy [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c09974200c464b9e959d85a652545f5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6208d85f7b20490d88f6aab71cd1c1a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:59:51 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Creating image(s)
Nov 16 00:59:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "/opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "/opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.216s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.194s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk 1073741824" returned: 0 in 0.053s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.211s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Cannot resize image /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Ensure instance console log exists: /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:52 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Successfully created port: 50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "58c57f68-f803-4913-9f4b-0573a523c19e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Successfully updated port: 50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquired lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 00:59:53 user nova-compute[75826]: INFO nova.compute.claims [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Claim successful on node user
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-d713578c-4467-4cf3-9d94-3dc3352c7b35 req-22c053ad-a47a-4a4b-ae1f-b99a98e46f88 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-changed-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-d713578c-4467-4cf3-9d94-3dc3352c7b35 req-22c053ad-a47a-4a4b-ae1f-b99a98e46f88 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Refreshing instance network info cache due to event network-changed-50cf91b8-33b8-4556-8bee-bb6565d7ef4d. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d713578c-4467-4cf3-9d94-3dc3352c7b35 req-22c053ad-a47a-4a4b-ae1f-b99a98e46f88 service nova] Acquiring lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updating instance_info_cache with network_info: [{"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.364s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Releasing lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Instance network_info: |[{"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d713578c-4467-4cf3-9d94-3dc3352c7b35 req-22c053ad-a47a-4a4b-ae1f-b99a98e46f88 service nova] Acquired lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-d713578c-4467-4cf3-9d94-3dc3352c7b35 req-22c053ad-a47a-4a4b-ae1f-b99a98e46f88 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Refreshing network info cache for port 50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Start _get_guest_xml network_info=[{"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:59:53 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:59:53 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2098629411',display_name='tempest-ServerStableDeviceRescueTest-server-2098629411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2098629411',id=42,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJ49rcYlPu3AwbxNJbwyRMkBPACuPDXxnYanYtoYF2FYYgtFksOxLarA127kouUH5sYUE8xCpEXsRT8jFvSPd4lNUBJS0YkQFomGha4ZIFiABnTeNbLU8q0P5A5RSWTCw==',key_name='tempest-keypair-2011727660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6208d85f7b20490d88f6aab71cd1c1a1',ramdisk_id='',reservation_id='r-02brzyic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1527052191',owner_user_name='tempest-ServerStableDeviceRescueTest-1527052191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c09974200c464b9e959d85a652545f5c',uuid=0fdae035-f108-4ea2-a70d-aa31a0e8522f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Converting VIF {"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2d:d0,bridge_name='br-int',has_traffic_filtering=True,id=50cf91b8-33b8-4556-8bee-bb6565d7ef4d,network=Network(c361bb6e-88c9-49af-862e-91799c7b1ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50cf91b8-33') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.objects.instance [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:59:53 user nova-compute[75826]:   <uuid>0fdae035-f108-4ea2-a70d-aa31a0e8522f</uuid>
Nov 16 00:59:53 user nova-compute[75826]:   <name>instance-0000002a</name>
Nov 16 00:59:53 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:59:53 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:59:53 user nova-compute[75826]:   <metadata>
Nov 16 00:59:53 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:59:53 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:59:53 user nova-compute[75826]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2098629411</nova:name>
Nov 16 00:59:53 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:59:53</nova:creationTime>
Nov 16 00:59:53 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:59:53 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:59:53 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:59:53 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:59:53 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:59:53 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:59:53 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:59:53 user nova-compute[75826]:       <nova:owner>
Nov 16 00:59:53 user nova-compute[75826]:         <nova:user uuid="c09974200c464b9e959d85a652545f5c">tempest-ServerStableDeviceRescueTest-1527052191-project-member</nova:user>
Nov 16 00:59:53 user nova-compute[75826]:         <nova:project uuid="6208d85f7b20490d88f6aab71cd1c1a1">tempest-ServerStableDeviceRescueTest-1527052191</nova:project>
Nov 16 00:59:53 user nova-compute[75826]:       </nova:owner>
Nov 16 00:59:53 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:59:53 user nova-compute[75826]:       <nova:ports>
Nov 16 00:59:53 user nova-compute[75826]:         <nova:port uuid="50cf91b8-33b8-4556-8bee-bb6565d7ef4d">
Nov 16 00:59:53 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 00:59:53 user nova-compute[75826]:         </nova:port>
Nov 16 00:59:53 user nova-compute[75826]:       </nova:ports>
Nov 16 00:59:53 user nova-compute[75826]:     </nova:instance>
Nov 16 00:59:53 user nova-compute[75826]:   </metadata>
Nov 16 00:59:53 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:59:53 user nova-compute[75826]:     <system>
Nov 16 00:59:53 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:59:53 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:59:53 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:59:53 user nova-compute[75826]:       <entry name="serial">0fdae035-f108-4ea2-a70d-aa31a0e8522f</entry>
Nov 16 00:59:53 user nova-compute[75826]:       <entry name="uuid">0fdae035-f108-4ea2-a70d-aa31a0e8522f</entry>
Nov 16 00:59:53 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:59:53 user nova-compute[75826]:     </system>
Nov 16 00:59:53 user nova-compute[75826]:   </sysinfo>
Nov 16 00:59:53 user nova-compute[75826]:   <os>
Nov 16 00:59:53 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:59:53 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:59:53 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:59:53 user nova-compute[75826]:   </os>
Nov 16 00:59:53 user nova-compute[75826]:   <features>
Nov 16 00:59:53 user nova-compute[75826]:     <acpi/>
Nov 16 00:59:53 user nova-compute[75826]:     <apic/>
Nov 16 00:59:53 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:59:53 user nova-compute[75826]:   </features>
Nov 16 00:59:53 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:59:53 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:59:53 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:59:53 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:59:53 user nova-compute[75826]:   </clock>
Nov 16 00:59:53 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:59:53 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:59:53 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:59:53 user nova-compute[75826]:   </cpu>
Nov 16 00:59:53 user nova-compute[75826]:   <devices>
Nov 16 00:59:53 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:59:53 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:59:53 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk"/>
Nov 16 00:59:53 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:59:53 user nova-compute[75826]:     </disk>
Nov 16 00:59:53 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:59:53 user nova-compute[75826]:       <mac address="fa:16:3e:5d:2d:d0"/>
Nov 16 00:59:53 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:59:53 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:59:53 user nova-compute[75826]:       <target dev="tap50cf91b8-33"/>
Nov 16 00:59:53 user nova-compute[75826]:     </interface>
Nov 16 00:59:53 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:59:53 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/console.log" append="off"/>
Nov 16 00:59:53 user nova-compute[75826]:     </serial>
Nov 16 00:59:53 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:59:53 user nova-compute[75826]:     <video>
Nov 16 00:59:53 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:59:53 user nova-compute[75826]:     </video>
Nov 16 00:59:53 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:59:53 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:59:53 user nova-compute[75826]:     </rng>
Nov 16 00:59:53 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:59:53 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:59:53 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:59:53 user nova-compute[75826]:     </memballoon>
Nov 16 00:59:53 user nova-compute[75826]:   </devices>
Nov 16 00:59:53 user nova-compute[75826]: </domain>
Nov 16 00:59:53 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2098629411',display_name='tempest-ServerStableDeviceRescueTest-server-2098629411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2098629411',id=42,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJ49rcYlPu3AwbxNJbwyRMkBPACuPDXxnYanYtoYF2FYYgtFksOxLarA127kouUH5sYUE8xCpEXsRT8jFvSPd4lNUBJS0YkQFomGha4ZIFiABnTeNbLU8q0P5A5RSWTCw==',key_name='tempest-keypair-2011727660',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6208d85f7b20490d88f6aab71cd1c1a1',ramdisk_id='',reservation_id='r-02brzyic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1527052191',owner_user_name='tempest-ServerStableDeviceRescueTest-1527052191-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:59:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c09974200c464b9e959d85a652545f5c',uuid=0fdae035-f108-4ea2-a70d-aa31a0e8522f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Converting VIF {"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2d:d0,bridge_name='br-int',has_traffic_filtering=True,id=50cf91b8-33b8-4556-8bee-bb6565d7ef4d,network=Network(c361bb6e-88c9-49af-862e-91799c7b1ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50cf91b8-33') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG os_vif [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2d:d0,bridge_name='br-int',has_traffic_filtering=True,id=50cf91b8-33b8-4556-8bee-bb6565d7ef4d,network=Network(c361bb6e-88c9-49af-862e-91799c7b1ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50cf91b8-33') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5fdc645a-620e-522d-ad6f-e0345cd7c02c', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50cf91b8-33, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap50cf91b8-33, col_values=(('qos', UUID('40452326-c433-407d-a995-7c64e46e615d')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap50cf91b8-33, col_values=(('external_ids', {'iface-id': '50cf91b8-33b8-4556-8bee-bb6565d7ef4d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:2d:d0', 'vm-uuid': '0fdae035-f108-4ea2-a70d-aa31a0e8522f'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:53 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:53 user nova-compute[75826]: INFO os_vif [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:2d:d0,bridge_name='br-int',has_traffic_filtering=True,id=50cf91b8-33b8-4556-8bee-bb6565d7ef4d,network=Network(c361bb6e-88c9-49af-862e-91799c7b1ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50cf91b8-33')
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] No VIF found with MAC fa:16:3e:5d:2d:d0, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:59:53 user nova-compute[75826]: DEBUG nova.policy [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'feba48e8625343afbe69f1b108c1521b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19420df617844f17a0e95a0981e12885', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 00:59:54 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Creating image(s)
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "/opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "/opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "/opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG nova.network.neutron [req-d713578c-4467-4cf3-9d94-3dc3352c7b35 req-22c053ad-a47a-4a4b-ae1f-b99a98e46f88 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updated VIF entry in instance network info cache for port 50cf91b8-33b8-4556-8bee-bb6565d7ef4d. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG nova.network.neutron [req-d713578c-4467-4cf3-9d94-3dc3352c7b35 req-22c053ad-a47a-4a4b-ae1f-b99a98e46f88 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updating instance_info_cache with network_info: [{"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d713578c-4467-4cf3-9d94-3dc3352c7b35 req-22c053ad-a47a-4a4b-ae1f-b99a98e46f88 service nova] Releasing lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk 1073741824" returned: 0 in 0.053s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Cannot resize image /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Ensure instance console log exists: /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:55 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Successfully created port: f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 00:59:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-33227922-fae9-4d71-8b50-2af971044e0f req-35b962fb-0428-4c49-ba81-36a3ec09b789 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-33227922-fae9-4d71-8b50-2af971044e0f req-35b962fb-0428-4c49-ba81-36a3ec09b789 service nova] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-33227922-fae9-4d71-8b50-2af971044e0f req-35b962fb-0428-4c49-ba81-36a3ec09b789 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-33227922-fae9-4d71-8b50-2af971044e0f req-35b962fb-0428-4c49-ba81-36a3ec09b789 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-33227922-fae9-4d71-8b50-2af971044e0f req-35b962fb-0428-4c49-ba81-36a3ec09b789 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] No waiting events found dispatching network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:59:55 user nova-compute[75826]: WARNING nova.compute.manager [req-33227922-fae9-4d71-8b50-2af971044e0f req-35b962fb-0428-4c49-ba81-36a3ec09b789 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received unexpected event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d for instance with vm_state building and task_state spawning.
Nov 16 00:59:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Successfully updated port: f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "refresh_cache-58c57f68-f803-4913-9f4b-0573a523c19e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquired lock "refresh_cache-58c57f68-f803-4913-9f4b-0573a523c19e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-90e12212-c264-4a1c-a9ee-b4689fc9f5c5 req-04ae44c8-b25a-4399-9186-a9c82a3981da service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Received event network-changed-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.compute.manager [req-90e12212-c264-4a1c-a9ee-b4689fc9f5c5 req-04ae44c8-b25a-4399-9186-a9c82a3981da service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Refreshing instance network info cache due to event network-changed-f098d5e2-cd70-4e61-a01f-28a6970f5bd5. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90e12212-c264-4a1c-a9ee-b4689fc9f5c5 req-04ae44c8-b25a-4399-9186-a9c82a3981da service nova] Acquiring lock "refresh_cache-58c57f68-f803-4913-9f4b-0573a523c19e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Updating instance_info_cache with network_info: [{"id": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "address": "fa:16:3e:f6:ec:4b", "network": {"id": "4f1a960f-26cc-41c1-97e6-7b053aec17b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-743130817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19420df617844f17a0e95a0981e12885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf098d5e2-cd", "ovs_interfaceid": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Releasing lock "refresh_cache-58c57f68-f803-4913-9f4b-0573a523c19e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Instance network_info: |[{"id": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "address": "fa:16:3e:f6:ec:4b", "network": {"id": "4f1a960f-26cc-41c1-97e6-7b053aec17b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-743130817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19420df617844f17a0e95a0981e12885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf098d5e2-cd", "ovs_interfaceid": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90e12212-c264-4a1c-a9ee-b4689fc9f5c5 req-04ae44c8-b25a-4399-9186-a9c82a3981da service nova] Acquired lock "refresh_cache-58c57f68-f803-4913-9f4b-0573a523c19e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-90e12212-c264-4a1c-a9ee-b4689fc9f5c5 req-04ae44c8-b25a-4399-9186-a9c82a3981da service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Refreshing network info cache for port f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Start _get_guest_xml network_info=[{"id": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "address": "fa:16:3e:f6:ec:4b", "network": {"id": "4f1a960f-26cc-41c1-97e6-7b053aec17b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-743130817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19420df617844f17a0e95a0981e12885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf098d5e2-cd", "ovs_interfaceid": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 00:59:56 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:59:56 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2054260231',display_name='tempest-TestServerVolumeAttachmentScenario-server-2054260231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2054260231',id=43,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWD51GOsxcurp2seN8WOl59qo/wmDinMP/7XRB/FwB2fTP/YtLgoQUCMIWkZq2zvbgDDMwCR6MDgBMEBta0/4FfpSDJmeiRi2ebmylfWfzSj4ltu6bF2yR03IkFFaCENg==',key_name='tempest-keypair-1667353561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19420df617844f17a0e95a0981e12885',ramdisk_id='',reservation_id='r-dattevtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2080812168',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2080812168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:59:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feba48e8625343afbe69f1b108c1521b',uuid=58c57f68-f803-4913-9f4b-0573a523c19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "address": "fa:16:3e:f6:ec:4b", "network": {"id": "4f1a960f-26cc-41c1-97e6-7b053aec17b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-743130817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19420df617844f17a0e95a0981e12885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf098d5e2-cd", "ovs_interfaceid": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Converting VIF {"id": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "address": "fa:16:3e:f6:ec:4b", "network": {"id": "4f1a960f-26cc-41c1-97e6-7b053aec17b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-743130817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19420df617844f17a0e95a0981e12885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf098d5e2-cd", "ovs_interfaceid": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=f098d5e2-cd70-4e61-a01f-28a6970f5bd5,network=Network(4f1a960f-26cc-41c1-97e6-7b053aec17b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf098d5e2-cd') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.objects.instance [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lazy-loading 'pci_devices' on Instance uuid 58c57f68-f803-4913-9f4b-0573a523c19e {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] End _get_guest_xml xml=<domain type="kvm">
Nov 16 00:59:56 user nova-compute[75826]:   <uuid>58c57f68-f803-4913-9f4b-0573a523c19e</uuid>
Nov 16 00:59:56 user nova-compute[75826]:   <name>instance-0000002b</name>
Nov 16 00:59:56 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 00:59:56 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 00:59:56 user nova-compute[75826]:   <metadata>
Nov 16 00:59:56 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 00:59:56 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 00:59:56 user nova-compute[75826]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-2054260231</nova:name>
Nov 16 00:59:56 user nova-compute[75826]:       <nova:creationTime>2023-11-16 00:59:56</nova:creationTime>
Nov 16 00:59:56 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 00:59:56 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 00:59:56 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 00:59:56 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 00:59:56 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 00:59:56 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 00:59:56 user nova-compute[75826]:       </nova:flavor>
Nov 16 00:59:56 user nova-compute[75826]:       <nova:owner>
Nov 16 00:59:56 user nova-compute[75826]:         <nova:user uuid="feba48e8625343afbe69f1b108c1521b">tempest-TestServerVolumeAttachmentScenario-2080812168-project-member</nova:user>
Nov 16 00:59:56 user nova-compute[75826]:         <nova:project uuid="19420df617844f17a0e95a0981e12885">tempest-TestServerVolumeAttachmentScenario-2080812168</nova:project>
Nov 16 00:59:56 user nova-compute[75826]:       </nova:owner>
Nov 16 00:59:56 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 00:59:56 user nova-compute[75826]:       <nova:ports>
Nov 16 00:59:56 user nova-compute[75826]:         <nova:port uuid="f098d5e2-cd70-4e61-a01f-28a6970f5bd5">
Nov 16 00:59:56 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 16 00:59:56 user nova-compute[75826]:         </nova:port>
Nov 16 00:59:56 user nova-compute[75826]:       </nova:ports>
Nov 16 00:59:56 user nova-compute[75826]:     </nova:instance>
Nov 16 00:59:56 user nova-compute[75826]:   </metadata>
Nov 16 00:59:56 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 00:59:56 user nova-compute[75826]:     <system>
Nov 16 00:59:56 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 00:59:56 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 00:59:56 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 00:59:56 user nova-compute[75826]:       <entry name="serial">58c57f68-f803-4913-9f4b-0573a523c19e</entry>
Nov 16 00:59:56 user nova-compute[75826]:       <entry name="uuid">58c57f68-f803-4913-9f4b-0573a523c19e</entry>
Nov 16 00:59:56 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 00:59:56 user nova-compute[75826]:     </system>
Nov 16 00:59:56 user nova-compute[75826]:   </sysinfo>
Nov 16 00:59:56 user nova-compute[75826]:   <os>
Nov 16 00:59:56 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 00:59:56 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 00:59:56 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 00:59:56 user nova-compute[75826]:   </os>
Nov 16 00:59:56 user nova-compute[75826]:   <features>
Nov 16 00:59:56 user nova-compute[75826]:     <acpi/>
Nov 16 00:59:56 user nova-compute[75826]:     <apic/>
Nov 16 00:59:56 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 00:59:56 user nova-compute[75826]:   </features>
Nov 16 00:59:56 user nova-compute[75826]:   <clock offset="utc">
Nov 16 00:59:56 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 00:59:56 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 00:59:56 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 00:59:56 user nova-compute[75826]:   </clock>
Nov 16 00:59:56 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 00:59:56 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 00:59:56 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 00:59:56 user nova-compute[75826]:   </cpu>
Nov 16 00:59:56 user nova-compute[75826]:   <devices>
Nov 16 00:59:56 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 00:59:56 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 00:59:56 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk"/>
Nov 16 00:59:56 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 00:59:56 user nova-compute[75826]:     </disk>
Nov 16 00:59:56 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 00:59:56 user nova-compute[75826]:       <mac address="fa:16:3e:f6:ec:4b"/>
Nov 16 00:59:56 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:59:56 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 00:59:56 user nova-compute[75826]:       <target dev="tapf098d5e2-cd"/>
Nov 16 00:59:56 user nova-compute[75826]:     </interface>
Nov 16 00:59:56 user nova-compute[75826]:     <serial type="pty">
Nov 16 00:59:56 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/console.log" append="off"/>
Nov 16 00:59:56 user nova-compute[75826]:     </serial>
Nov 16 00:59:56 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 00:59:56 user nova-compute[75826]:     <video>
Nov 16 00:59:56 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 00:59:56 user nova-compute[75826]:     </video>
Nov 16 00:59:56 user nova-compute[75826]:     <rng model="virtio">
Nov 16 00:59:56 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 00:59:56 user nova-compute[75826]:     </rng>
Nov 16 00:59:56 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 00:59:56 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 00:59:56 user nova-compute[75826]:       <stats period="10"/>
Nov 16 00:59:56 user nova-compute[75826]:     </memballoon>
Nov 16 00:59:56 user nova-compute[75826]:   </devices>
Nov 16 00:59:56 user nova-compute[75826]: </domain>
Nov 16 00:59:56 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2054260231',display_name='tempest-TestServerVolumeAttachmentScenario-server-2054260231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2054260231',id=43,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWD51GOsxcurp2seN8WOl59qo/wmDinMP/7XRB/FwB2fTP/YtLgoQUCMIWkZq2zvbgDDMwCR6MDgBMEBta0/4FfpSDJmeiRi2ebmylfWfzSj4ltu6bF2yR03IkFFaCENg==',key_name='tempest-keypair-1667353561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19420df617844f17a0e95a0981e12885',ramdisk_id='',reservation_id='r-dattevtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2080812168',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2080812168-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T00:59:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feba48e8625343afbe69f1b108c1521b',uuid=58c57f68-f803-4913-9f4b-0573a523c19e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "address": "fa:16:3e:f6:ec:4b", "network": {"id": "4f1a960f-26cc-41c1-97e6-7b053aec17b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-743130817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19420df617844f17a0e95a0981e12885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf098d5e2-cd", "ovs_interfaceid": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Converting VIF {"id": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "address": "fa:16:3e:f6:ec:4b", "network": {"id": "4f1a960f-26cc-41c1-97e6-7b053aec17b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-743130817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19420df617844f17a0e95a0981e12885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf098d5e2-cd", "ovs_interfaceid": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=f098d5e2-cd70-4e61-a01f-28a6970f5bd5,network=Network(4f1a960f-26cc-41c1-97e6-7b053aec17b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf098d5e2-cd') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG os_vif [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=f098d5e2-cd70-4e61-a01f-28a6970f5bd5,network=Network(4f1a960f-26cc-41c1-97e6-7b053aec17b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf098d5e2-cd') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4dec0ab4-895b-520e-99f2-4c592f2b742f', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf098d5e2-cd, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf098d5e2-cd, col_values=(('qos', UUID('12477a7b-6bc3-4247-bc13-d1146205e0f6')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf098d5e2-cd, col_values=(('external_ids', {'iface-id': 'f098d5e2-cd70-4e61-a01f-28a6970f5bd5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:ec:4b', 'vm-uuid': '58c57f68-f803-4913-9f4b-0573a523c19e'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:56 user nova-compute[75826]: INFO os_vif [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=f098d5e2-cd70-4e61-a01f-28a6970f5bd5,network=Network(4f1a960f-26cc-41c1-97e6-7b053aec17b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf098d5e2-cd')
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] No VIF found with MAC fa:16:3e:f6:ec:4b, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-90e12212-c264-4a1c-a9ee-b4689fc9f5c5 req-04ae44c8-b25a-4399-9186-a9c82a3981da service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Updated VIF entry in instance network info cache for port f098d5e2-cd70-4e61-a01f-28a6970f5bd5. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-90e12212-c264-4a1c-a9ee-b4689fc9f5c5 req-04ae44c8-b25a-4399-9186-a9c82a3981da service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Updating instance_info_cache with network_info: [{"id": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "address": "fa:16:3e:f6:ec:4b", "network": {"id": "4f1a960f-26cc-41c1-97e6-7b053aec17b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-743130817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19420df617844f17a0e95a0981e12885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf098d5e2-cd", "ovs_interfaceid": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 00:59:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90e12212-c264-4a1c-a9ee-b4689fc9f5c5 req-04ae44c8-b25a-4399-9186-a9c82a3981da service nova] Releasing lock "refresh_cache-58c57f68-f803-4913-9f4b-0573a523c19e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 00:59:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Instance spawned successfully.
Nov 16 00:59:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 00:59:57 user nova-compute[75826]: INFO nova.compute.manager [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Took 6.13 seconds to spawn the instance on the hypervisor.
Nov 16 00:59:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-482a8e21-8175-45d3-823b-bb5f8e8b819e req-bd4ea2cb-f026-4102-ad01-d5e287a9adae service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-482a8e21-8175-45d3-823b-bb5f8e8b819e req-bd4ea2cb-f026-4102-ad01-d5e287a9adae service nova] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-482a8e21-8175-45d3-823b-bb5f8e8b819e req-bd4ea2cb-f026-4102-ad01-d5e287a9adae service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-482a8e21-8175-45d3-823b-bb5f8e8b819e req-bd4ea2cb-f026-4102-ad01-d5e287a9adae service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-482a8e21-8175-45d3-823b-bb5f8e8b819e req-bd4ea2cb-f026-4102-ad01-d5e287a9adae service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] No waiting events found dispatching network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:59:57 user nova-compute[75826]: WARNING nova.compute.manager [req-482a8e21-8175-45d3-823b-bb5f8e8b819e req-bd4ea2cb-f026-4102-ad01-d5e287a9adae service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received unexpected event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d for instance with vm_state building and task_state spawning.
Nov 16 00:59:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:57 user nova-compute[75826]: INFO nova.compute.manager [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Took 6.93 seconds to build instance.
Nov 16 00:59:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7cf935b3-eee7-43de-8796-27d1a60d6dd6 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.055s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-1b274734-7fa9-435d-80ec-e818f59d442e req-66d09db6-ab65-4d18-969c-a48a6f691f77 service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Received event network-vif-plugged-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 00:59:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1b274734-7fa9-435d-80ec-e818f59d442e req-66d09db6-ab65-4d18-969c-a48a6f691f77 service nova] Acquiring lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 00:59:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1b274734-7fa9-435d-80ec-e818f59d442e req-66d09db6-ab65-4d18-969c-a48a6f691f77 service nova] Lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 00:59:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1b274734-7fa9-435d-80ec-e818f59d442e req-66d09db6-ab65-4d18-969c-a48a6f691f77 service nova] Lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 00:59:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-1b274734-7fa9-435d-80ec-e818f59d442e req-66d09db6-ab65-4d18-969c-a48a6f691f77 service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] No waiting events found dispatching network-vif-plugged-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 00:59:58 user nova-compute[75826]: WARNING nova.compute.manager [req-1b274734-7fa9-435d-80ec-e818f59d442e req-66d09db6-ab65-4d18-969c-a48a6f691f77 service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Received unexpected event network-vif-plugged-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 for instance with vm_state building and task_state spawning.
Nov 16 00:59:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 00:59:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 01:00:00 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Instance spawned successfully.
Nov 16 01:00:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-18cd6214-b67b-458b-a32c-3df060e522d2 req-098b1c5c-0356-4f16-9094-e29fcf0c966d service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Received event network-vif-plugged-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-18cd6214-b67b-458b-a32c-3df060e522d2 req-098b1c5c-0356-4f16-9094-e29fcf0c966d service nova] Acquiring lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-18cd6214-b67b-458b-a32c-3df060e522d2 req-098b1c5c-0356-4f16-9094-e29fcf0c966d service nova] Lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-18cd6214-b67b-458b-a32c-3df060e522d2 req-098b1c5c-0356-4f16-9094-e29fcf0c966d service nova] Lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-18cd6214-b67b-458b-a32c-3df060e522d2 req-098b1c5c-0356-4f16-9094-e29fcf0c966d service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] No waiting events found dispatching network-vif-plugged-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:00 user nova-compute[75826]: WARNING nova.compute.manager [req-18cd6214-b67b-458b-a32c-3df060e522d2 req-098b1c5c-0356-4f16-9094-e29fcf0c966d service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Received unexpected event network-vif-plugged-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 for instance with vm_state building and task_state spawning.
Nov 16 01:00:00 user nova-compute[75826]: INFO nova.compute.manager [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Took 6.23 seconds to spawn the instance on the hypervisor.
Nov 16 01:00:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:00:00 user nova-compute[75826]: INFO nova.compute.manager [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Took 7.04 seconds to build instance.
Nov 16 01:00:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2fc4c91e-d67d-4cdb-828f-6b1993fa7f80 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.145s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:09 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:00:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:00:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:00:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:00:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:00:09 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Updating instance_info_cache with network_info: [{"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:00:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-7d7971e0-c96d-4690-8a14-033f6dd35776" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:00:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:00:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:00:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:12 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:00:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:00:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:00:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:00:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:17 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:00:17 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7952MB free_disk=25.216819763183594GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance f2aeb101-4454-4a86-9e77-9426c732d526 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 58c57f68-f803-4913-9f4b-0573a523c19e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing inventories for resource provider 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating ProviderTree inventory for provider 015246d3-5250-41ea-8943-b837ba3f5938 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating inventory in ProviderTree for provider 015246d3-5250-41ea-8943-b837ba3f5938 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing aggregate associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, aggregates: None {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 01:00:17 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing trait associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 01:00:18 user nova-compute[75826]: INFO nova.compute.manager [None req-fc77b5ea-61d2-4282-8592-0490bc8e3bb6 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Unrescuing
Nov 16 01:00:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fc77b5ea-61d2-4282-8592-0490bc8e3bb6 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:00:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fc77b5ea-61d2-4282-8592-0490bc8e3bb6 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquired lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:00:18 user nova-compute[75826]: DEBUG nova.network.neutron [None req-fc77b5ea-61d2-4282-8592-0490bc8e3bb6 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:00:18 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:00:18 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:00:18 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:00:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.774s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:18 user nova-compute[75826]: DEBUG nova.network.neutron [None req-fc77b5ea-61d2-4282-8592-0490bc8e3bb6 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updating instance_info_cache with network_info: [{"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:00:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-fc77b5ea-61d2-4282-8592-0490bc8e3bb6 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Releasing lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:00:18 user nova-compute[75826]: DEBUG nova.objects.instance [None req-fc77b5ea-61d2-4282-8592-0490bc8e3bb6 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'flavor' on Instance uuid f2aeb101-4454-4a86-9e77-9426c732d526 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:00:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG nova.compute.manager [req-53785c40-4d4f-4f91-b105-7d4f61ab0d6b req-d3b9085c-c515-4b5c-9745-2d5db326cb36 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-unplugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-53785c40-4d4f-4f91-b105-7d4f61ab0d6b req-d3b9085c-c515-4b5c-9745-2d5db326cb36 service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-53785c40-4d4f-4f91-b105-7d4f61ab0d6b req-d3b9085c-c515-4b5c-9745-2d5db326cb36 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-53785c40-4d4f-4f91-b105-7d4f61ab0d6b req-d3b9085c-c515-4b5c-9745-2d5db326cb36 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG nova.compute.manager [req-53785c40-4d4f-4f91-b105-7d4f61ab0d6b req-d3b9085c-c515-4b5c-9745-2d5db326cb36 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-unplugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:19 user nova-compute[75826]: WARNING nova.compute.manager [req-53785c40-4d4f-4f91-b105-7d4f61ab0d6b req-d3b9085c-c515-4b5c-9745-2d5db326cb36 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-unplugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state rescued and task_state unrescuing.
Nov 16 01:00:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:19 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Instance destroyed successfully.
Nov 16 01:00:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:19 user nova-compute[75826]: INFO nova.compute.manager [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Terminating instance
Nov 16 01:00:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75826) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG nova.compute.manager [req-3b8dc745-6db9-4ce5-9bf4-a8e9fd27ec81 req-b30b5a3a-a8ab-4337-99e6-4496b158448d service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received event network-vif-unplugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3b8dc745-6db9-4ce5-9bf4-a8e9fd27ec81 req-b30b5a3a-a8ab-4337-99e6-4496b158448d service nova] Acquiring lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3b8dc745-6db9-4ce5-9bf4-a8e9fd27ec81 req-b30b5a3a-a8ab-4337-99e6-4496b158448d service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3b8dc745-6db9-4ce5-9bf4-a8e9fd27ec81 req-b30b5a3a-a8ab-4337-99e6-4496b158448d service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG nova.compute.manager [req-3b8dc745-6db9-4ce5-9bf4-a8e9fd27ec81 req-b30b5a3a-a8ab-4337-99e6-4496b158448d service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] No waiting events found dispatching network-vif-unplugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:20 user nova-compute[75826]: DEBUG nova.compute.manager [req-3b8dc745-6db9-4ce5-9bf4-a8e9fd27ec81 req-b30b5a3a-a8ab-4337-99e6-4496b158448d service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received event network-vif-unplugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:21 user nova-compute[75826]: WARNING nova.compute.manager [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state rescued and task_state unrescuing.
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:21 user nova-compute[75826]: WARNING nova.compute.manager [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state rescued and task_state unrescuing.
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:21 user nova-compute[75826]: WARNING nova.compute.manager [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state rescued and task_state unrescuing.
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-unplugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.compute.manager [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-unplugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:21 user nova-compute[75826]: WARNING nova.compute.manager [req-6062d2b8-e851-4028-ad3a-b449903b6bb2 req-ca0433f0-5c05-4a3a-921d-65dcd5401ed8 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-unplugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state rescued and task_state unrescuing.
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Instance destroyed successfully.
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lazy-loading 'resources' on Instance uuid 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:55:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-817916153',display_name='tempest-TestVolumeBootPattern-volume-backed-server-817916153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-817916153',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsbSdXDHIqBFr67lLAupRb4mCxK8GoNRtHRTwLhubj0rip0gLpCVs47h62VSJwSTkVeXFahh1Jqx+yDWeipZOCbPrH2x5lr0Ok4LQEIDNpyd6SdlclD8E5WY57E4Nd3vA==',key_name='tempest-keypair-1836084774',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:55:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-82mshcq5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:55:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6c17265442bc48f9b6de5367e91096b2',uuid=24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "address": "fa:16:3e:f7:30:c4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bc56ab-de", "ovs_interfaceid": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "address": "fa:16:3e:f7:30:c4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap65bc56ab-de", "ovs_interfaceid": "65bc56ab-de8e-44dc-938b-1bb5d84d7fcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=65bc56ab-de8e-44dc-938b-1bb5d84d7fcb,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bc56ab-de') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_vif [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=65bc56ab-de8e-44dc-938b-1bb5d84d7fcb,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bc56ab-de') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap65bc56ab-de, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=443dec37-f816-49c5-b238-2beb4588506b) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:00:21 user nova-compute[75826]: INFO os_vif [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:30:c4,bridge_name='br-int',has_traffic_filtering=True,id=65bc56ab-de8e-44dc-938b-1bb5d84d7fcb,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap65bc56ab-de')
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YfjsiECh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:00:21 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1c374c-e9dd-4fc4-962c-5f762a381cd6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:00:21 user nova-compute[75826]: No targets found.
Nov 16 01:00:21 user nova-compute[75826]: iSNS:
Nov 16 01:00:21 user nova-compute[75826]: No targets found.
Nov 16 01:00:21 user nova-compute[75826]: STATIC:
Nov 16 01:00:21 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9
Nov 16 01:00:21 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:00:21 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:00:21 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb
Nov 16 01:00:21 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:00:21 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:00:21 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d
Nov 16 01:00:21 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:00:21 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:00:21 user nova-compute[75826]: FIRMWARE:
Nov 16 01:00:21 user nova-compute[75826]: No targets found.
Nov 16 01:00:21 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:00:21 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:00:21 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c2583d-888b-42cb-8c3d-9b4239593aa0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[885192e9-7c25-458d-826b-b5a1dc3f9dc2]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 01:00:21 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:00:21 user nova-compute[75826]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 01:00:21 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 (non-flash)
Nov 16 01:00:21 user nova-compute[75826]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:00:21 user nova-compute[75826]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 01:00:21 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd9435b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9'): ({'sdd'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Removing single pathed devices sdd {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe40057-ea8a-478a-b01a-86284cc65f6b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[457101ab-d54c-4fe2-ab43-b2f397cf3a3f]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flushing IO for device /dev/sdd {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a2072b-1769-41be-9249-0fa08c34f1a6]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.056s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[166fdc3e-1cb2-4cb9-a459-fe2d82b9509b]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[920be5ff-f3c2-4a2b-b098-2e184b2bfd69]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f33998-a211-4a3f-b9cc-82fbebadb224]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9, portal: 172.16.0.220,3260]
Nov 16 01:00:21 user nova-compute[75826]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9, portal: 172.16.0.220,3260] successful.
Nov 16 01:00:21 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:75914f2c-118c-4b41-93fb-79305d33dab9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e974b0-0087-4ee6-93dc-6778c5fa0b28]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== disconnect_volume: return (374ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:00:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:00:21 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Deleting instance files /opt/stack/data/nova/instances/24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a_del
Nov 16 01:00:21 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Deletion of /opt/stack/data/nova/instances/24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a_del complete
Nov 16 01:00:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:22 user nova-compute[75826]: INFO nova.compute.manager [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Took 2.10 seconds to destroy the instance on the hypervisor.
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received event network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Acquiring lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] No waiting events found dispatching network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:22 user nova-compute[75826]: WARNING nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received unexpected event network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb for instance with vm_state active and task_state deleting.
Nov 16 01:00:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received event network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Acquiring lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] No waiting events found dispatching network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:22 user nova-compute[75826]: WARNING nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received unexpected event network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb for instance with vm_state active and task_state deleting.
Nov 16 01:00:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received event network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Acquiring lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] No waiting events found dispatching network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:22 user nova-compute[75826]: WARNING nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received unexpected event network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb for instance with vm_state active and task_state deleting.
Nov 16 01:00:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received event network-vif-unplugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Acquiring lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] No waiting events found dispatching network-vif-unplugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received event network-vif-unplugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received event network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Acquiring lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] No waiting events found dispatching network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:22 user nova-compute[75826]: WARNING nova.compute.manager [req-90399f3f-e50d-4fb2-adb0-b88a4db8f15d req-31987a07-f665-4e60-a2c0-a56ef0661d44 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received unexpected event network-vif-plugged-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb for instance with vm_state active and task_state deleting.
Nov 16 01:00:23 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:00:23 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Took 0.95 seconds to deallocate network for instance.
Nov 16 01:00:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-86a02df1-5349-4397-ad25-c7b6942def61 req-aa5eed88-6706-427e-93d1-882db4448cbf service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-86a02df1-5349-4397-ad25-c7b6942def61 req-aa5eed88-6706-427e-93d1-882db4448cbf service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-86a02df1-5349-4397-ad25-c7b6942def61 req-aa5eed88-6706-427e-93d1-882db4448cbf service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-86a02df1-5349-4397-ad25-c7b6942def61 req-aa5eed88-6706-427e-93d1-882db4448cbf service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:23 user nova-compute[75826]: DEBUG nova.compute.manager [req-86a02df1-5349-4397-ad25-c7b6942def61 req-aa5eed88-6706-427e-93d1-882db4448cbf service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:23 user nova-compute[75826]: WARNING nova.compute.manager [req-86a02df1-5349-4397-ad25-c7b6942def61 req-aa5eed88-6706-427e-93d1-882db4448cbf service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state rescued and task_state unrescuing.
Nov 16 01:00:23 user nova-compute[75826]: INFO nova.compute.manager [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Took 0.75 seconds to detach 1 volumes for instance.
Nov 16 01:00:23 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Deleting volume: 75914f2c-118c-4b41-93fb-79305d33dab9 {{(pid=75826) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 01:00:23 user nova-compute[75826]: DEBUG nova.compute.manager [None req-fc77b5ea-61d2-4282-8592-0490bc8e3bb6 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:00:24 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:00:24 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 01:00:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:24 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] There are 0 instances to clean {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 01:00:24 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:00:24 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:00:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:24 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Deleted allocations for instance 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a
Nov 16 01:00:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f262fb6-ee83-4ea6-a7c1-b0e66111c8d1 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.520s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-83475561-b820-413d-92aa-32073a51debc req-785b718b-5fc6-418e-9651-57c995622089 service nova] [instance: 24fb31f4-c00b-48f0-b0f6-5ce0a4fa327a] Received event network-vif-deleted-65bc56ab-de8e-44dc-938b-1bb5d84d7fcb {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:25 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:00:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 01:00:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:27 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 01:00:27 user nova-compute[75826]: INFO nova.compute.claims [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Claim successful on node user
Nov 16 01:00:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-71ada7f9-0bef-47e0-9bc9-c8a5da908743 req-45c80337-7dd5-4175-aa8c-d6de9cb63cee service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-71ada7f9-0bef-47e0-9bc9-c8a5da908743 req-45c80337-7dd5-4175-aa8c-d6de9cb63cee service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-71ada7f9-0bef-47e0-9bc9-c8a5da908743 req-45c80337-7dd5-4175-aa8c-d6de9cb63cee service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-71ada7f9-0bef-47e0-9bc9-c8a5da908743 req-45c80337-7dd5-4175-aa8c-d6de9cb63cee service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-71ada7f9-0bef-47e0-9bc9-c8a5da908743 req-45c80337-7dd5-4175-aa8c-d6de9cb63cee service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:27 user nova-compute[75826]: WARNING nova.compute.manager [req-71ada7f9-0bef-47e0-9bc9-c8a5da908743 req-45c80337-7dd5-4175-aa8c-d6de9cb63cee service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state active and task_state None.
Nov 16 01:00:28 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 01:00:28 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 01:00:28 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG nova.policy [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5977fd80d89947a485bfff425143e52d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00e572425d9b49da8def94110f3b583f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 01:00:28 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Creating image(s)
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "/opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "/opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "/opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk 1073741824" returned: 0 in 0.051s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.264s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Successfully created port: 54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Cannot resize image /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Ensure instance console log exists: /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-7b4689dc-1727-4b57-9dfa-01ef7787e109 req-cf9ba51e-2416-46c3-8f22-9551997fcfa4 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7b4689dc-1727-4b57-9dfa-01ef7787e109 req-cf9ba51e-2416-46c3-8f22-9551997fcfa4 service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7b4689dc-1727-4b57-9dfa-01ef7787e109 req-cf9ba51e-2416-46c3-8f22-9551997fcfa4 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7b4689dc-1727-4b57-9dfa-01ef7787e109 req-cf9ba51e-2416-46c3-8f22-9551997fcfa4 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-7b4689dc-1727-4b57-9dfa-01ef7787e109 req-cf9ba51e-2416-46c3-8f22-9551997fcfa4 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:29 user nova-compute[75826]: WARNING nova.compute.manager [req-7b4689dc-1727-4b57-9dfa-01ef7787e109 req-cf9ba51e-2416-46c3-8f22-9551997fcfa4 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state active and task_state None.
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Successfully updated port: 54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "refresh_cache-8705a8fc-b910-45b0-9d54-12b525954bee" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquired lock "refresh_cache-8705a8fc-b910-45b0-9d54-12b525954bee" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-25740b05-b433-4110-b4ea-eee34a8535a6 req-17856746-5a8e-4e1d-895a-ee3f29a4080f service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received event network-changed-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-25740b05-b433-4110-b4ea-eee34a8535a6 req-17856746-5a8e-4e1d-895a-ee3f29a4080f service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Refreshing instance network info cache due to event network-changed-54b9a96a-3659-41b7-a654-9bfab1f475fd. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-25740b05-b433-4110-b4ea-eee34a8535a6 req-17856746-5a8e-4e1d-895a-ee3f29a4080f service nova] Acquiring lock "refresh_cache-8705a8fc-b910-45b0-9d54-12b525954bee" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.network.neutron [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Updating instance_info_cache with network_info: [{"id": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "address": "fa:16:3e:a4:09:88", "network": {"id": "ad13eecf-14bf-4dab-85fa-eac1e5a6bc82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-369970053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00e572425d9b49da8def94110f3b583f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b9a96a-36", "ovs_interfaceid": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Releasing lock "refresh_cache-8705a8fc-b910-45b0-9d54-12b525954bee" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Instance network_info: |[{"id": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "address": "fa:16:3e:a4:09:88", "network": {"id": "ad13eecf-14bf-4dab-85fa-eac1e5a6bc82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-369970053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00e572425d9b49da8def94110f3b583f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b9a96a-36", "ovs_interfaceid": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-25740b05-b433-4110-b4ea-eee34a8535a6 req-17856746-5a8e-4e1d-895a-ee3f29a4080f service nova] Acquired lock "refresh_cache-8705a8fc-b910-45b0-9d54-12b525954bee" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.network.neutron [req-25740b05-b433-4110-b4ea-eee34a8535a6 req-17856746-5a8e-4e1d-895a-ee3f29a4080f service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Refreshing network info cache for port 54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Start _get_guest_xml network_info=[{"id": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "address": "fa:16:3e:a4:09:88", "network": {"id": "ad13eecf-14bf-4dab-85fa-eac1e5a6bc82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-369970053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00e572425d9b49da8def94110f3b583f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b9a96a-36", "ovs_interfaceid": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 01:00:30 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:00:30 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1656028919',display_name='tempest-SnapshotDataIntegrityTests-server-1656028919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1656028919',id=44,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHIUO8Fx4CUnkQ0BfmWuiYe9f7NCktH3kZbNifYYmBFqp4y+wzlFFMbSRS9Ze7YlNtijVbGs2TCM0jryG+/CUBb/NoTYphNCCgD3CAmP5hHQeL5q6Gb2Eyc1p++oMdOYQ==',key_name='tempest-keypair-413667159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00e572425d9b49da8def94110f3b583f',ramdisk_id='',reservation_id='r-r903x4id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1117230790',owner_user_name='tempest-SnapshotDataIntegrityTests-1117230790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5977fd80d89947a485bfff425143e52d',uuid=8705a8fc-b910-45b0-9d54-12b525954bee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "address": "fa:16:3e:a4:09:88", "network": {"id": "ad13eecf-14bf-4dab-85fa-eac1e5a6bc82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-369970053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00e572425d9b49da8def94110f3b583f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b9a96a-36", "ovs_interfaceid": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Converting VIF {"id": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "address": "fa:16:3e:a4:09:88", "network": {"id": "ad13eecf-14bf-4dab-85fa-eac1e5a6bc82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-369970053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00e572425d9b49da8def94110f3b583f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b9a96a-36", "ovs_interfaceid": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:09:88,bridge_name='br-int',has_traffic_filtering=True,id=54b9a96a-3659-41b7-a654-9bfab1f475fd,network=Network(ad13eecf-14bf-4dab-85fa-eac1e5a6bc82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b9a96a-36') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.objects.instance [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'pci_devices' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] End _get_guest_xml xml=<domain type="kvm">
Nov 16 01:00:30 user nova-compute[75826]:   <uuid>8705a8fc-b910-45b0-9d54-12b525954bee</uuid>
Nov 16 01:00:30 user nova-compute[75826]:   <name>instance-0000002c</name>
Nov 16 01:00:30 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 01:00:30 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 01:00:30 user nova-compute[75826]:   <metadata>
Nov 16 01:00:30 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 01:00:30 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 01:00:30 user nova-compute[75826]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1656028919</nova:name>
Nov 16 01:00:30 user nova-compute[75826]:       <nova:creationTime>2023-11-16 01:00:30</nova:creationTime>
Nov 16 01:00:30 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 01:00:30 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 01:00:30 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 01:00:30 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 01:00:30 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 01:00:30 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 01:00:30 user nova-compute[75826]:       </nova:flavor>
Nov 16 01:00:30 user nova-compute[75826]:       <nova:owner>
Nov 16 01:00:30 user nova-compute[75826]:         <nova:user uuid="5977fd80d89947a485bfff425143e52d">tempest-SnapshotDataIntegrityTests-1117230790-project-member</nova:user>
Nov 16 01:00:30 user nova-compute[75826]:         <nova:project uuid="00e572425d9b49da8def94110f3b583f">tempest-SnapshotDataIntegrityTests-1117230790</nova:project>
Nov 16 01:00:30 user nova-compute[75826]:       </nova:owner>
Nov 16 01:00:30 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 01:00:30 user nova-compute[75826]:       <nova:ports>
Nov 16 01:00:30 user nova-compute[75826]:         <nova:port uuid="54b9a96a-3659-41b7-a654-9bfab1f475fd">
Nov 16 01:00:30 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 01:00:30 user nova-compute[75826]:         </nova:port>
Nov 16 01:00:30 user nova-compute[75826]:       </nova:ports>
Nov 16 01:00:30 user nova-compute[75826]:     </nova:instance>
Nov 16 01:00:30 user nova-compute[75826]:   </metadata>
Nov 16 01:00:30 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 01:00:30 user nova-compute[75826]:     <system>
Nov 16 01:00:30 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 01:00:30 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 01:00:30 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 01:00:30 user nova-compute[75826]:       <entry name="serial">8705a8fc-b910-45b0-9d54-12b525954bee</entry>
Nov 16 01:00:30 user nova-compute[75826]:       <entry name="uuid">8705a8fc-b910-45b0-9d54-12b525954bee</entry>
Nov 16 01:00:30 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 01:00:30 user nova-compute[75826]:     </system>
Nov 16 01:00:30 user nova-compute[75826]:   </sysinfo>
Nov 16 01:00:30 user nova-compute[75826]:   <os>
Nov 16 01:00:30 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 01:00:30 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 01:00:30 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 01:00:30 user nova-compute[75826]:   </os>
Nov 16 01:00:30 user nova-compute[75826]:   <features>
Nov 16 01:00:30 user nova-compute[75826]:     <acpi/>
Nov 16 01:00:30 user nova-compute[75826]:     <apic/>
Nov 16 01:00:30 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 01:00:30 user nova-compute[75826]:   </features>
Nov 16 01:00:30 user nova-compute[75826]:   <clock offset="utc">
Nov 16 01:00:30 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 01:00:30 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 01:00:30 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 01:00:30 user nova-compute[75826]:   </clock>
Nov 16 01:00:30 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 01:00:30 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 01:00:30 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 01:00:30 user nova-compute[75826]:   </cpu>
Nov 16 01:00:30 user nova-compute[75826]:   <devices>
Nov 16 01:00:30 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 01:00:30 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 01:00:30 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk"/>
Nov 16 01:00:30 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 01:00:30 user nova-compute[75826]:     </disk>
Nov 16 01:00:30 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 01:00:30 user nova-compute[75826]:       <mac address="fa:16:3e:a4:09:88"/>
Nov 16 01:00:30 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:00:30 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 01:00:30 user nova-compute[75826]:       <target dev="tap54b9a96a-36"/>
Nov 16 01:00:30 user nova-compute[75826]:     </interface>
Nov 16 01:00:30 user nova-compute[75826]:     <serial type="pty">
Nov 16 01:00:30 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/console.log" append="off"/>
Nov 16 01:00:30 user nova-compute[75826]:     </serial>
Nov 16 01:00:30 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 01:00:30 user nova-compute[75826]:     <video>
Nov 16 01:00:30 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:00:30 user nova-compute[75826]:     </video>
Nov 16 01:00:30 user nova-compute[75826]:     <rng model="virtio">
Nov 16 01:00:30 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 01:00:30 user nova-compute[75826]:     </rng>
Nov 16 01:00:30 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 01:00:30 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 01:00:30 user nova-compute[75826]:       <stats period="10"/>
Nov 16 01:00:30 user nova-compute[75826]:     </memballoon>
Nov 16 01:00:30 user nova-compute[75826]:   </devices>
Nov 16 01:00:30 user nova-compute[75826]: </domain>
Nov 16 01:00:30 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1656028919',display_name='tempest-SnapshotDataIntegrityTests-server-1656028919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1656028919',id=44,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHIUO8Fx4CUnkQ0BfmWuiYe9f7NCktH3kZbNifYYmBFqp4y+wzlFFMbSRS9Ze7YlNtijVbGs2TCM0jryG+/CUBb/NoTYphNCCgD3CAmP5hHQeL5q6Gb2Eyc1p++oMdOYQ==',key_name='tempest-keypair-413667159',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='00e572425d9b49da8def94110f3b583f',ramdisk_id='',reservation_id='r-r903x4id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1117230790',owner_user_name='tempest-SnapshotDataIntegrityTests-1117230790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:00:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5977fd80d89947a485bfff425143e52d',uuid=8705a8fc-b910-45b0-9d54-12b525954bee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "address": "fa:16:3e:a4:09:88", "network": {"id": "ad13eecf-14bf-4dab-85fa-eac1e5a6bc82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-369970053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00e572425d9b49da8def94110f3b583f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b9a96a-36", "ovs_interfaceid": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Converting VIF {"id": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "address": "fa:16:3e:a4:09:88", "network": {"id": "ad13eecf-14bf-4dab-85fa-eac1e5a6bc82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-369970053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00e572425d9b49da8def94110f3b583f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b9a96a-36", "ovs_interfaceid": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:09:88,bridge_name='br-int',has_traffic_filtering=True,id=54b9a96a-3659-41b7-a654-9bfab1f475fd,network=Network(ad13eecf-14bf-4dab-85fa-eac1e5a6bc82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b9a96a-36') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG os_vif [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:09:88,bridge_name='br-int',has_traffic_filtering=True,id=54b9a96a-3659-41b7-a654-9bfab1f475fd,network=Network(ad13eecf-14bf-4dab-85fa-eac1e5a6bc82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b9a96a-36') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a2ca552-db10-52d8-9ff9-40a996170167', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54b9a96a-36, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54b9a96a-36, col_values=(('qos', UUID('9524486b-d183-4374-ac94-6779df81a666')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54b9a96a-36, col_values=(('external_ids', {'iface-id': '54b9a96a-3659-41b7-a654-9bfab1f475fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:09:88', 'vm-uuid': '8705a8fc-b910-45b0-9d54-12b525954bee'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:30 user nova-compute[75826]: INFO os_vif [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:09:88,bridge_name='br-int',has_traffic_filtering=True,id=54b9a96a-3659-41b7-a654-9bfab1f475fd,network=Network(ad13eecf-14bf-4dab-85fa-eac1e5a6bc82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b9a96a-36')
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:00:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No VIF found with MAC fa:16:3e:a4:09:88, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:00:31 user nova-compute[75826]: DEBUG nova.network.neutron [req-25740b05-b433-4110-b4ea-eee34a8535a6 req-17856746-5a8e-4e1d-895a-ee3f29a4080f service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Updated VIF entry in instance network info cache for port 54b9a96a-3659-41b7-a654-9bfab1f475fd. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:00:31 user nova-compute[75826]: DEBUG nova.network.neutron [req-25740b05-b433-4110-b4ea-eee34a8535a6 req-17856746-5a8e-4e1d-895a-ee3f29a4080f service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Updating instance_info_cache with network_info: [{"id": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "address": "fa:16:3e:a4:09:88", "network": {"id": "ad13eecf-14bf-4dab-85fa-eac1e5a6bc82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-369970053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00e572425d9b49da8def94110f3b583f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b9a96a-36", "ovs_interfaceid": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:00:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-25740b05-b433-4110-b4ea-eee34a8535a6 req-17856746-5a8e-4e1d-895a-ee3f29a4080f service nova] Releasing lock "refresh_cache-8705a8fc-b910-45b0-9d54-12b525954bee" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:00:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:32 user nova-compute[75826]: DEBUG nova.compute.manager [req-da514ca2-f1c8-407b-aae2-c59bd8ebaf9b req-f6bc4d22-cd97-4b74-9dea-483589d3eab9 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received event network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-da514ca2-f1c8-407b-aae2-c59bd8ebaf9b req-f6bc4d22-cd97-4b74-9dea-483589d3eab9 service nova] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-da514ca2-f1c8-407b-aae2-c59bd8ebaf9b req-f6bc4d22-cd97-4b74-9dea-483589d3eab9 service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-da514ca2-f1c8-407b-aae2-c59bd8ebaf9b req-f6bc4d22-cd97-4b74-9dea-483589d3eab9 service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:32 user nova-compute[75826]: DEBUG nova.compute.manager [req-da514ca2-f1c8-407b-aae2-c59bd8ebaf9b req-f6bc4d22-cd97-4b74-9dea-483589d3eab9 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] No waiting events found dispatching network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:32 user nova-compute[75826]: WARNING nova.compute.manager [req-da514ca2-f1c8-407b-aae2-c59bd8ebaf9b req-f6bc4d22-cd97-4b74-9dea-483589d3eab9 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received unexpected event network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd for instance with vm_state building and task_state spawning.
Nov 16 01:00:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 01:00:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 01:00:34 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Instance spawned successfully.
Nov 16 01:00:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 01:00:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:00:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:00:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:00:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:00:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:00:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:00:34 user nova-compute[75826]: INFO nova.compute.manager [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Took 6.32 seconds to spawn the instance on the hypervisor.
Nov 16 01:00:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:00:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-247039a4-af35-43aa-a9ec-3eff78b94543 req-c5a34213-13e6-45f9-baf1-1e11434a3cc0 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received event network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-247039a4-af35-43aa-a9ec-3eff78b94543 req-c5a34213-13e6-45f9-baf1-1e11434a3cc0 service nova] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-247039a4-af35-43aa-a9ec-3eff78b94543 req-c5a34213-13e6-45f9-baf1-1e11434a3cc0 service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-247039a4-af35-43aa-a9ec-3eff78b94543 req-c5a34213-13e6-45f9-baf1-1e11434a3cc0 service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:34 user nova-compute[75826]: DEBUG nova.compute.manager [req-247039a4-af35-43aa-a9ec-3eff78b94543 req-c5a34213-13e6-45f9-baf1-1e11434a3cc0 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] No waiting events found dispatching network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:00:34 user nova-compute[75826]: WARNING nova.compute.manager [req-247039a4-af35-43aa-a9ec-3eff78b94543 req-c5a34213-13e6-45f9-baf1-1e11434a3cc0 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received unexpected event network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd for instance with vm_state building and task_state spawning.
Nov 16 01:00:34 user nova-compute[75826]: INFO nova.compute.manager [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Took 7.13 seconds to build instance.
Nov 16 01:00:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-a30f71c8-af6f-42b8-9253-9d00748b4e6d tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.253s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:00:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-7c3c60ba-1ceb-42a7-a144-627d30a0906f req-423869c0-8555-4857-ac64-817da57a4a1a service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-changed-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-7c3c60ba-1ceb-42a7-a144-627d30a0906f req-423869c0-8555-4857-ac64-817da57a4a1a service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Refreshing instance network info cache due to event network-changed-9891b7e5-c4e1-4202-ad4d-adbb33abfac6. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7c3c60ba-1ceb-42a7-a144-627d30a0906f req-423869c0-8555-4857-ac64-817da57a4a1a service nova] Acquiring lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7c3c60ba-1ceb-42a7-a144-627d30a0906f req-423869c0-8555-4857-ac64-817da57a4a1a service nova] Acquired lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-7c3c60ba-1ceb-42a7-a144-627d30a0906f req-423869c0-8555-4857-ac64-817da57a4a1a service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Refreshing network info cache for port 9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-7c3c60ba-1ceb-42a7-a144-627d30a0906f req-423869c0-8555-4857-ac64-817da57a4a1a service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updated VIF entry in instance network info cache for port 9891b7e5-c4e1-4202-ad4d-adbb33abfac6. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-7c3c60ba-1ceb-42a7-a144-627d30a0906f req-423869c0-8555-4857-ac64-817da57a4a1a service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updating instance_info_cache with network_info: [{"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7c3c60ba-1ceb-42a7-a144-627d30a0906f req-423869c0-8555-4857-ac64-817da57a4a1a service nova] Releasing lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-8bde4425-951b-4f3e-946d-168bfc00504c req-1b44a490-f66c-4073-8c74-3c2f2ea2c9cd service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-changed-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG nova.compute.manager [req-8bde4425-951b-4f3e-946d-168bfc00504c req-1b44a490-f66c-4073-8c74-3c2f2ea2c9cd service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Refreshing instance network info cache due to event network-changed-9891b7e5-c4e1-4202-ad4d-adbb33abfac6. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bde4425-951b-4f3e-946d-168bfc00504c req-1b44a490-f66c-4073-8c74-3c2f2ea2c9cd service nova] Acquiring lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bde4425-951b-4f3e-946d-168bfc00504c req-1b44a490-f66c-4073-8c74-3c2f2ea2c9cd service nova] Acquired lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:00:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-8bde4425-951b-4f3e-946d-168bfc00504c req-1b44a490-f66c-4073-8c74-3c2f2ea2c9cd service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Refreshing network info cache for port 9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:00:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:00:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:00:54 user nova-compute[75826]: INFO nova.compute.manager [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Detaching volume 9d194355-7fd2-4919-a590-e78e4e7e4bdb
Nov 16 01:00:54 user nova-compute[75826]: INFO nova.virt.block_device [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Attempting to driver detach volume 9d194355-7fd2-4919-a590-e78e4e7e4bdb from mountpoint /dev/vdb
Nov 16 01:00:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Attempting to detach device vdb from instance 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 01:00:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:00:54 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:00:54 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 01:00:54 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:00:54 user nova-compute[75826]:   <serial>9d194355-7fd2-4919-a590-e78e4e7e4bdb</serial>
Nov 16 01:00:54 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 01:00:54 user nova-compute[75826]: </disk>
Nov 16 01:00:54 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:00:54 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Successfully detached device vdb from instance 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 from the persistent domain config.
Nov 16 01:00:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 01:00:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:00:54 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:00:54 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 01:00:54 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:00:54 user nova-compute[75826]:   <serial>9d194355-7fd2-4919-a590-e78e4e7e4bdb</serial>
Nov 16 01:00:54 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 16 01:00:54 user nova-compute[75826]: </disk>
Nov 16 01:00:54 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:00:54 user nova-compute[75826]: DEBUG nova.network.neutron [req-8bde4425-951b-4f3e-946d-168bfc00504c req-1b44a490-f66c-4073-8c74-3c2f2ea2c9cd service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updated VIF entry in instance network info cache for port 9891b7e5-c4e1-4202-ad4d-adbb33abfac6. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:00:54 user nova-compute[75826]: DEBUG nova.network.neutron [req-8bde4425-951b-4f3e-946d-168bfc00504c req-1b44a490-f66c-4073-8c74-3c2f2ea2c9cd service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updating instance_info_cache with network_info: [{"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:00:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bde4425-951b-4f3e-946d-168bfc00504c req-1b44a490-f66c-4073-8c74-3c2f2ea2c9cd service nova] Releasing lock "refresh_cache-9fe77732-86b7-4e9e-ac07-0eef8f9d1405" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:00:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 01:00:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:00:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:01:11 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:01:11 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:01:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:01:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:01:11 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:01:11 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updating instance_info_cache with network_info: [{"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:01:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:01:11 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:01:12 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:01:14 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 is timed out.
Nov 16 01:01:14 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Successfully detached device vdb from instance 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 from the live domain config.
Nov 16 01:01:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RSbPqXKl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:01:14 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:01:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[56148657-19f8-4eb4-80bc-980b33166a98]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:01:14 user nova-compute[75826]: No targets found.
Nov 16 01:01:14 user nova-compute[75826]: iSNS:
Nov 16 01:01:14 user nova-compute[75826]: No targets found.
Nov 16 01:01:14 user nova-compute[75826]: STATIC:
Nov 16 01:01:14 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb
Nov 16 01:01:14 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:01:14 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:01:14 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d
Nov 16 01:01:14 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:01:14 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:01:14 user nova-compute[75826]: FIRMWARE:
Nov 16 01:01:14 user nova-compute[75826]: No targets found.
Nov 16 01:01:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:01:14 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:01:14 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e91482-d083-4be2-bdbd-ab94595d91c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ae4e79-0f31-499d-9bb0-a10b79d42561]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:01:14 user nova-compute[75826]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 01:01:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:01:14 user nova-compute[75826]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb (non-flash)
Nov 16 01:01:14 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd94235870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb'): ({'sde'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Removing single pathed devices sde {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bd08c4-9642-4baf-8e0b-1e6fc1dd3888]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9f5359-dfd0-4969-b226-4079aee0f75a]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Flushing IO for device /dev/sde {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:01:14 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7414634-61f4-4e38-bbd5-69a6058cf37c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f8bc5b-b2ed-41c5-a931-29b548c8fe84]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6e2e4b-2245-46c4-9ab0-4b545b9551d4]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1b153a-ac22-4e1c-80cb-2885ae7bd25d]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260]
Nov 16 01:01:15 user nova-compute[75826]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb, portal: 172.16.0.220,3260] successful.
Nov 16 01:01:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9d194355-7fd2-4919-a590-e78e4e7e4bdb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cc243d-f3e2-4223-8719-a0872be4b6ae]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] <== disconnect_volume: return (316ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:01:15 user nova-compute[75826]: DEBUG nova.objects.instance [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'flavor' on Instance uuid 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-0c91f305-e712-4162-bb4d-a5a6ccf07958 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.730s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:01:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:19 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:01:19 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:01:19 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=7954MB free_disk=25.171680450439453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance f2aeb101-4454-4a86-9e77-9426c732d526 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 58c57f68-f803-4913-9f4b-0573a523c19e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 8705a8fc-b910-45b0-9d54-12b525954bee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:01:19 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.391s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 01:01:20 user nova-compute[75826]: INFO nova.compute.claims [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Claim successful on node user
Nov 16 01:01:20 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.343s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 01:01:20 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 01:01:20 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 01:01:20 user nova-compute[75826]: INFO nova.virt.block_device [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Booting with volume b37fc46e-6c9d-45a0-93b9-9182c0453ff6 at /dev/vda
Nov 16 01:01:20 user nova-compute[75826]: DEBUG nova.policy [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c17265442bc48f9b6de5367e91096b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4135693756414fb70826b0f1d9345c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG os_brick.utils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b76b89c-7e10-432b-a420-eef6960d5e7b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b3bf33-bb86-48a7-b54c-215603226b31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c5599b-2eac-42ad-be2d-30aeb0bb0ab2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[696fbef6-6129-4c7d-b6ce-f5e56c36b053]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:01:20 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 01:01:20 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1bcfd1-e116-4d1c-b484-31c667d19e71]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG os_brick.utils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:01:20 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Updating existing volume attachment record: 895a9066-6da4-4f96-89bf-e8dc9b143527 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 01:01:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:01:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:01:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:01:21 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Successfully created port: 2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 01:01:22 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:01:22 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:01:22 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Successfully updated port: 2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 01:01:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "refresh_cache-b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:01:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquired lock "refresh_cache-b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:01:22 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:01:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-29388856-7b6c-405e-87c5-91d821d83611 req-7dbf4777-8382-40cb-9377-74598b93bdf5 service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Received event network-changed-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:01:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-29388856-7b6c-405e-87c5-91d821d83611 req-7dbf4777-8382-40cb-9377-74598b93bdf5 service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Refreshing instance network info cache due to event network-changed-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:01:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-29388856-7b6c-405e-87c5-91d821d83611 req-7dbf4777-8382-40cb-9377-74598b93bdf5 service nova] Acquiring lock "refresh_cache-b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:01:22 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 01:01:23 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Updating instance_info_cache with network_info: [{"id": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "address": "fa:16:3e:25:66:f4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2540b0a5-b8", "ovs_interfaceid": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:01:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Releasing lock "refresh_cache-b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:01:23 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Instance network_info: |[{"id": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "address": "fa:16:3e:25:66:f4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2540b0a5-b8", "ovs_interfaceid": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 01:01:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-29388856-7b6c-405e-87c5-91d821d83611 req-7dbf4777-8382-40cb-9377-74598b93bdf5 service nova] Acquired lock "refresh_cache-b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:01:23 user nova-compute[75826]: DEBUG nova.network.neutron [req-29388856-7b6c-405e-87c5-91d821d83611 req-7dbf4777-8382-40cb-9377-74598b93bdf5 service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Refreshing network info cache for port 2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:01:23 user nova-compute[75826]: DEBUG nova.network.neutron [req-29388856-7b6c-405e-87c5-91d821d83611 req-7dbf4777-8382-40cb-9377-74598b93bdf5 service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Updated VIF entry in instance network info cache for port 2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:01:23 user nova-compute[75826]: DEBUG nova.network.neutron [req-29388856-7b6c-405e-87c5-91d821d83611 req-7dbf4777-8382-40cb-9377-74598b93bdf5 service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Updating instance_info_cache with network_info: [{"id": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "address": "fa:16:3e:25:66:f4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2540b0a5-b8", "ovs_interfaceid": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:01:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-29388856-7b6c-405e-87c5-91d821d83611 req-7dbf4777-8382-40cb-9377-74598b93bdf5 service nova] Releasing lock "refresh_cache-b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 01:01:25 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Creating image(s)
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Ensure instance console log exists: /opt/stack/data/nova/instances/b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Start _get_guest_xml network_info=[{"id": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "address": "fa:16:3e:25:66:f4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2540b0a5-b8", "ovs_interfaceid": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '895a9066-6da4-4f96-89bf-e8dc9b143527', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEiqpoGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b', 'attached_at': '', 'detached_at': '', 'volume_id': 'b37fc46e-6c9d-45a0-93b9-9182c0453ff6', 'serial': 'b37fc46e-6c9d-45a0-93b9-9182c0453ff6'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 01:01:25 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:01:25 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEiqpoGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:01:25 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:01:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:01:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:01:26 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:01:26 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0767d321-0c70-4c6b-8079-704814f6e53e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 01:01:26 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b31f6c1-5956-4553-aae7-648baf0b63cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6] added
Nov 16 01:01:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed40d495-e77e-4c9c-b3b3-402cb640aa08]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4783c6dc-3d73-4460-8324-07385c0410b8]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEiqpoGe {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEiqpoGe" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[934ec707-aae6-4d93-af42-4a913698a371]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aEiqpoGe'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8653dd05-3946-4690-a2e6-14ecb1367a6d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4553c5d-fd43-48a6-9b5c-6801b21dc460]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:01:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:01:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[42552535-1115-415e-bbf6-93ad0ccb5ba6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260]
Nov 16 01:01:26 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260] successful.
Nov 16 01:01:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3ff081d-d677-4532-98f5-3730726b36d3]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[128fdd71-a9ef-402a-a919-43d1b3a822e4]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:01:26 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:01:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:01:26 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:01:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed930770-c844-4e94-b5fe-d5efdcf4a29a]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:26 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEiqpoGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23862346362643562', 'path': '/dev/sdc'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862346362643562', 'path': '/dev/sdc'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:01:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1525736367',display_name='tempest-TestVolumeBootPattern-server-1525736367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1525736367',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm3ahxdyhMyQRGdodmVB4rNyVTsBs9l2wJPImRwyG338XqNyzGOLQ50rip2YKesURLjC0iv5HRzeJcmp1NyHE7ZZ5taylxF05FJcu5bUEFb8Cv7u/1iu868o42QyRdnsQ==',key_name='tempest-TestVolumeBootPattern-1182608151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-264mbu8y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:01:21Z,user_data=None,user_id='6c17265442bc48f9b6de5367e91096b2',uuid=b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "address": "fa:16:3e:25:66:f4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2540b0a5-b8", "ovs_interfaceid": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "address": "fa:16:3e:25:66:f4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2540b0a5-b8", "ovs_interfaceid": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:66:f4,bridge_name='br-int',has_traffic_filtering=True,id=2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2540b0a5-b8') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG nova.objects.instance [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lazy-loading 'pci_devices' on Instance uuid b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] End _get_guest_xml xml=<domain type="kvm">
Nov 16 01:01:27 user nova-compute[75826]:   <uuid>b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b</uuid>
Nov 16 01:01:27 user nova-compute[75826]:   <name>instance-0000002d</name>
Nov 16 01:01:27 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 01:01:27 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 01:01:27 user nova-compute[75826]:   <metadata>
Nov 16 01:01:27 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 01:01:27 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 01:01:27 user nova-compute[75826]:       <nova:name>tempest-TestVolumeBootPattern-server-1525736367</nova:name>
Nov 16 01:01:27 user nova-compute[75826]:       <nova:creationTime>2023-11-16 01:01:25</nova:creationTime>
Nov 16 01:01:27 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 01:01:27 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 01:01:27 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 01:01:27 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 01:01:27 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 01:01:27 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 01:01:27 user nova-compute[75826]:       </nova:flavor>
Nov 16 01:01:27 user nova-compute[75826]:       <nova:owner>
Nov 16 01:01:27 user nova-compute[75826]:         <nova:user uuid="6c17265442bc48f9b6de5367e91096b2">tempest-TestVolumeBootPattern-2108626012-project-member</nova:user>
Nov 16 01:01:27 user nova-compute[75826]:         <nova:project uuid="ef4135693756414fb70826b0f1d9345c">tempest-TestVolumeBootPattern-2108626012</nova:project>
Nov 16 01:01:27 user nova-compute[75826]:       </nova:owner>
Nov 16 01:01:27 user nova-compute[75826]:       <nova:ports>
Nov 16 01:01:27 user nova-compute[75826]:         <nova:port uuid="2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c">
Nov 16 01:01:27 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 01:01:27 user nova-compute[75826]:         </nova:port>
Nov 16 01:01:27 user nova-compute[75826]:       </nova:ports>
Nov 16 01:01:27 user nova-compute[75826]:     </nova:instance>
Nov 16 01:01:27 user nova-compute[75826]:   </metadata>
Nov 16 01:01:27 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 01:01:27 user nova-compute[75826]:     <system>
Nov 16 01:01:27 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 01:01:27 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 01:01:27 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 01:01:27 user nova-compute[75826]:       <entry name="serial">b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b</entry>
Nov 16 01:01:27 user nova-compute[75826]:       <entry name="uuid">b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b</entry>
Nov 16 01:01:27 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 01:01:27 user nova-compute[75826]:     </system>
Nov 16 01:01:27 user nova-compute[75826]:   </sysinfo>
Nov 16 01:01:27 user nova-compute[75826]:   <os>
Nov 16 01:01:27 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 01:01:27 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 01:01:27 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 01:01:27 user nova-compute[75826]:   </os>
Nov 16 01:01:27 user nova-compute[75826]:   <features>
Nov 16 01:01:27 user nova-compute[75826]:     <acpi/>
Nov 16 01:01:27 user nova-compute[75826]:     <apic/>
Nov 16 01:01:27 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 01:01:27 user nova-compute[75826]:   </features>
Nov 16 01:01:27 user nova-compute[75826]:   <clock offset="utc">
Nov 16 01:01:27 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 01:01:27 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 01:01:27 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 01:01:27 user nova-compute[75826]:   </clock>
Nov 16 01:01:27 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 01:01:27 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 01:01:27 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 01:01:27 user nova-compute[75826]:   </cpu>
Nov 16 01:01:27 user nova-compute[75826]:   <devices>
Nov 16 01:01:27 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 01:01:27 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:01:27 user nova-compute[75826]:       <source dev="/dev/sdc"/>
Nov 16 01:01:27 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 01:01:27 user nova-compute[75826]:       <serial>b37fc46e-6c9d-45a0-93b9-9182c0453ff6</serial>
Nov 16 01:01:27 user nova-compute[75826]:     </disk>
Nov 16 01:01:27 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 01:01:27 user nova-compute[75826]:       <mac address="fa:16:3e:25:66:f4"/>
Nov 16 01:01:27 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:01:27 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 01:01:27 user nova-compute[75826]:       <target dev="tap2540b0a5-b8"/>
Nov 16 01:01:27 user nova-compute[75826]:     </interface>
Nov 16 01:01:27 user nova-compute[75826]:     <serial type="pty">
Nov 16 01:01:27 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b/console.log" append="off"/>
Nov 16 01:01:27 user nova-compute[75826]:     </serial>
Nov 16 01:01:27 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 01:01:27 user nova-compute[75826]:     <video>
Nov 16 01:01:27 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:01:27 user nova-compute[75826]:     </video>
Nov 16 01:01:27 user nova-compute[75826]:     <rng model="virtio">
Nov 16 01:01:27 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 01:01:27 user nova-compute[75826]:     </rng>
Nov 16 01:01:27 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 01:01:27 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 01:01:27 user nova-compute[75826]:       <stats period="10"/>
Nov 16 01:01:27 user nova-compute[75826]:     </memballoon>
Nov 16 01:01:27 user nova-compute[75826]:   </devices>
Nov 16 01:01:27 user nova-compute[75826]: </domain>
Nov 16 01:01:27 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:01:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1525736367',display_name='tempest-TestVolumeBootPattern-server-1525736367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1525736367',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm3ahxdyhMyQRGdodmVB4rNyVTsBs9l2wJPImRwyG338XqNyzGOLQ50rip2YKesURLjC0iv5HRzeJcmp1NyHE7ZZ5taylxF05FJcu5bUEFb8Cv7u/1iu868o42QyRdnsQ==',key_name='tempest-TestVolumeBootPattern-1182608151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-264mbu8y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:01:21Z,user_data=None,user_id='6c17265442bc48f9b6de5367e91096b2',uuid=b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "address": "fa:16:3e:25:66:f4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2540b0a5-b8", "ovs_interfaceid": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "address": "fa:16:3e:25:66:f4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2540b0a5-b8", "ovs_interfaceid": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:66:f4,bridge_name='br-int',has_traffic_filtering=True,id=2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2540b0a5-b8') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG os_vif [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:66:f4,bridge_name='br-int',has_traffic_filtering=True,id=2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2540b0a5-b8') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '242fbc9c-e925-511e-8014-3fd665f50aa5', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2540b0a5-b8, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2540b0a5-b8, col_values=(('qos', UUID('dddeab23-e117-4747-a4db-3abb83ad14b1')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2540b0a5-b8, col_values=(('external_ids', {'iface-id': '2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:66:f4', 'vm-uuid': 'b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:27 user nova-compute[75826]: INFO os_vif [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:66:f4,bridge_name='br-int',has_traffic_filtering=True,id=2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2540b0a5-b8')
Nov 16 01:01:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:01:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] No VIF found with MAC fa:16:3e:25:66:f4, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:01:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-5eeabb9c-989c-4d73-b7a9-f37e3f2cc00e req-2dcc10ba-686c-4ce6-98f2-c1948929930e service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Received event network-vif-plugged-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:01:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5eeabb9c-989c-4d73-b7a9-f37e3f2cc00e req-2dcc10ba-686c-4ce6-98f2-c1948929930e service nova] Acquiring lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5eeabb9c-989c-4d73-b7a9-f37e3f2cc00e req-2dcc10ba-686c-4ce6-98f2-c1948929930e service nova] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5eeabb9c-989c-4d73-b7a9-f37e3f2cc00e req-2dcc10ba-686c-4ce6-98f2-c1948929930e service nova] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-5eeabb9c-989c-4d73-b7a9-f37e3f2cc00e req-2dcc10ba-686c-4ce6-98f2-c1948929930e service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] No waiting events found dispatching network-vif-plugged-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:01:29 user nova-compute[75826]: WARNING nova.compute.manager [req-5eeabb9c-989c-4d73-b7a9-f37e3f2cc00e req-2dcc10ba-686c-4ce6-98f2-c1948929930e service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Received unexpected event network-vif-plugged-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c for instance with vm_state building and task_state spawning.
Nov 16 01:01:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 01:01:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 01:01:30 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Instance spawned successfully.
Nov 16 01:01:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 01:01:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:01:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:01:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:01:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:01:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:01:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:01:31 user nova-compute[75826]: INFO nova.compute.manager [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Took 5.12 seconds to spawn the instance on the hypervisor.
Nov 16 01:01:31 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:01:31 user nova-compute[75826]: INFO nova.compute.manager [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Took 11.35 seconds to build instance.
Nov 16 01:01:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-5bd08611-e4c8-42bf-9f51-6aaaaacfa88d req-a8f4cf64-73d5-4630-970b-de0aa0e46293 service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Received event network-vif-plugged-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:01:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5bd08611-e4c8-42bf-9f51-6aaaaacfa88d req-a8f4cf64-73d5-4630-970b-de0aa0e46293 service nova] Acquiring lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5bd08611-e4c8-42bf-9f51-6aaaaacfa88d req-a8f4cf64-73d5-4630-970b-de0aa0e46293 service nova] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5bd08611-e4c8-42bf-9f51-6aaaaacfa88d req-a8f4cf64-73d5-4630-970b-de0aa0e46293 service nova] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-5bd08611-e4c8-42bf-9f51-6aaaaacfa88d req-a8f4cf64-73d5-4630-970b-de0aa0e46293 service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] No waiting events found dispatching network-vif-plugged-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:01:31 user nova-compute[75826]: WARNING nova.compute.manager [req-5bd08611-e4c8-42bf-9f51-6aaaaacfa88d req-a8f4cf64-73d5-4630-970b-de0aa0e46293 service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Received unexpected event network-vif-plugged-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c for instance with vm_state active and task_state None.
Nov 16 01:01:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9205ac89-561e-4ca3-835e-c34bb4cbdac5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.473s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-e1eca52d-083e-4321-8c9c-685a6a3795f2 req-48a1b2c5-a145-48d5-a6e6-6f3fdc2c4474 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-changed-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:01:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-e1eca52d-083e-4321-8c9c-685a6a3795f2 req-48a1b2c5-a145-48d5-a6e6-6f3fdc2c4474 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Refreshing instance network info cache due to event network-changed-50cf91b8-33b8-4556-8bee-bb6565d7ef4d. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:01:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e1eca52d-083e-4321-8c9c-685a6a3795f2 req-48a1b2c5-a145-48d5-a6e6-6f3fdc2c4474 service nova] Acquiring lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:01:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e1eca52d-083e-4321-8c9c-685a6a3795f2 req-48a1b2c5-a145-48d5-a6e6-6f3fdc2c4474 service nova] Acquired lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:01:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-e1eca52d-083e-4321-8c9c-685a6a3795f2 req-48a1b2c5-a145-48d5-a6e6-6f3fdc2c4474 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Refreshing network info cache for port 50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:01:42 user nova-compute[75826]: DEBUG nova.network.neutron [req-e1eca52d-083e-4321-8c9c-685a6a3795f2 req-48a1b2c5-a145-48d5-a6e6-6f3fdc2c4474 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updated VIF entry in instance network info cache for port 50cf91b8-33b8-4556-8bee-bb6565d7ef4d. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:01:42 user nova-compute[75826]: DEBUG nova.network.neutron [req-e1eca52d-083e-4321-8c9c-685a6a3795f2 req-48a1b2c5-a145-48d5-a6e6-6f3fdc2c4474 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updating instance_info_cache with network_info: [{"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:01:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e1eca52d-083e-4321-8c9c-685a6a3795f2 req-48a1b2c5-a145-48d5-a6e6-6f3fdc2c4474 service nova] Releasing lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:01:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:01:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:01:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:01:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:01:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-5dac113d-6c67-4c9c-a9d3-24c35f0d3a93 req-341065cb-f96c-4d4c-a337-693ac0851618 service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Received event network-changed-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:01:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-5dac113d-6c67-4c9c-a9d3-24c35f0d3a93 req-341065cb-f96c-4d4c-a337-693ac0851618 service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Refreshing instance network info cache due to event network-changed-f098d5e2-cd70-4e61-a01f-28a6970f5bd5. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:01:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5dac113d-6c67-4c9c-a9d3-24c35f0d3a93 req-341065cb-f96c-4d4c-a337-693ac0851618 service nova] Acquiring lock "refresh_cache-58c57f68-f803-4913-9f4b-0573a523c19e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:01:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5dac113d-6c67-4c9c-a9d3-24c35f0d3a93 req-341065cb-f96c-4d4c-a337-693ac0851618 service nova] Acquired lock "refresh_cache-58c57f68-f803-4913-9f4b-0573a523c19e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:01:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-5dac113d-6c67-4c9c-a9d3-24c35f0d3a93 req-341065cb-f96c-4d4c-a337-693ac0851618 service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Refreshing network info cache for port f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:01:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:01:44 user nova-compute[75826]: INFO nova.compute.manager [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] instance snapshotting
Nov 16 01:01:44 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Beginning live snapshot process
Nov 16 01:01:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json -f qcow2 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json -f qcow2" returned: 0 in 0.209s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json -f qcow2 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG nova.network.neutron [req-5dac113d-6c67-4c9c-a9d3-24c35f0d3a93 req-341065cb-f96c-4d4c-a337-693ac0851618 service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Updated VIF entry in instance network info cache for port f098d5e2-cd70-4e61-a01f-28a6970f5bd5. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG nova.network.neutron [req-5dac113d-6c67-4c9c-a9d3-24c35f0d3a93 req-341065cb-f96c-4d4c-a337-693ac0851618 service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Updating instance_info_cache with network_info: [{"id": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "address": "fa:16:3e:f6:ec:4b", "network": {"id": "4f1a960f-26cc-41c1-97e6-7b053aec17b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-743130817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19420df617844f17a0e95a0981e12885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf098d5e2-cd", "ovs_interfaceid": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5dac113d-6c67-4c9c-a9d3-24c35f0d3a93 req-341065cb-f96c-4d4c-a337-693ac0851618 service nova] Releasing lock "refresh_cache-58c57f68-f803-4913-9f4b-0573a523c19e" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json -f qcow2" returned: 0 in 0.210s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "58c57f68-f803-4913-9f4b-0573a523c19e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lazy-loading 'flavor' on Instance uuid 58c57f68-f803-4913-9f4b-0573a523c19e {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgrqsi4do/699c4ec71c06424da7559042d8839b29.delta 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgrqsi4do/699c4ec71c06424da7559042d8839b29.delta 1073741824" returned: 0 in 0.053s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:45 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "58c57f68-f803-4913-9f4b-0573a523c19e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:45 user nova-compute[75826]: INFO nova.compute.manager [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Attaching volume 369c56ae-c31e-48db-b49e-145a1f2e1acb to /dev/vdb
Nov 16 01:01:45 user nova-compute[75826]: DEBUG os_brick.utils [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d1e53d-5bc2-435d-a9f0-c958d4e59f59]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8964185b-bd09-46ad-a7c6-2060d303053c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[607880e9-31c6-4167-a814-840ba4996725]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d663394a-0cb5-4fe0-8d9a-f574722aa2b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:01:45 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 01:01:45 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7297209-44bf-45c7-a516-957003cc1b2c]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG os_brick.utils [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:01:45 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Updating existing volume attachment record: 27ad062b-0b7f-4cc7-be69-2273acdc3b8a {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 01:01:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 01:01:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75826) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 16 01:01:46 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 16 01:01:46 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 01:01:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgrqsi4do/699c4ec71c06424da7559042d8839b29.delta /opt/stack/data/nova/instances/snapshots/tmpgrqsi4do/699c4ec71c06424da7559042d8839b29 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgrqsi4do/699c4ec71c06424da7559042d8839b29.delta /opt/stack/data/nova/instances/snapshots/tmpgrqsi4do/699c4ec71c06424da7559042d8839b29" returned: 0 in 0.469s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Snapshot extracted, beginning image upload
Nov 16 01:01:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:48 user nova-compute[75826]: INFO nova.compute.manager [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Terminating instance
Nov 16 01:01:48 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-01acd444-9cea-44bb-9589-19b19daa4d5b req-83a48a03-3259-4443-8f6f-bd3f9a5350b0 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-vif-unplugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-01acd444-9cea-44bb-9589-19b19daa4d5b req-83a48a03-3259-4443-8f6f-bd3f9a5350b0 service nova] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-01acd444-9cea-44bb-9589-19b19daa4d5b req-83a48a03-3259-4443-8f6f-bd3f9a5350b0 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-01acd444-9cea-44bb-9589-19b19daa4d5b req-83a48a03-3259-4443-8f6f-bd3f9a5350b0 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-01acd444-9cea-44bb-9589-19b19daa4d5b req-83a48a03-3259-4443-8f6f-bd3f9a5350b0 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] No waiting events found dispatching network-vif-unplugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:01:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-01acd444-9cea-44bb-9589-19b19daa4d5b req-83a48a03-3259-4443-8f6f-bd3f9a5350b0 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-vif-unplugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:01:49 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Instance destroyed successfully.
Nov 16 01:01:49 user nova-compute[75826]: DEBUG nova.objects.instance [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'resources' on Instance uuid 9fe77732-86b7-4e9e-ac07-0eef8f9d1405 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:56:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1390751704',display_name='tempest-TestMinimumBasicScenario-server-1390751704',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1390751704',id=40,image_ref='de6c5cc5-005e-4fa8-9f5c-0acdff3eff50',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATszQpf97mXvPlPMw/Rcc7WhBJ8KfZflmFA/U/Qg15g3XxUIQBYedZJpwanKi7hNjXnDRb2dFKDFdA95Wcw9faV3VBX1hlc/s/P57pKnmvXD8ZiGwotD10hBdKtZrIgcw==',key_name='tempest-TestMinimumBasicScenario-1740530434',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:56:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fa5ce9593fc4a4ea55228dd113781f1',ramdisk_id='',reservation_id='r-2e83hvx2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='de6c5cc5-005e-4fa8-9f5c-0acdff3eff50',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1996581904',owner_user_name='tempest-TestMinimumBasicScenario-1996581904-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:59:09Z,user_data=None,user_id='64aa8a18510d4d56b341f56cf8d5d3dd',uuid=9fe77732-86b7-4e9e-ac07-0eef8f9d1405,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converting VIF {"id": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "address": "fa:16:3e:3b:01:ba", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9891b7e5-c4", "ovs_interfaceid": "9891b7e5-c4e1-4202-ad4d-adbb33abfac6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG os_vif [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9891b7e5-c4, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78211598-9a5f-42f5-ad1f-f8f6281ef835) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:49 user nova-compute[75826]: INFO os_vif [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:01:ba,bridge_name='br-int',has_traffic_filtering=True,id=9891b7e5-c4e1-4202-ad4d-adbb33abfac6,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9891b7e5-c4')
Nov 16 01:01:49 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Deleting instance files /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405_del
Nov 16 01:01:49 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Deletion of /opt/stack/data/nova/instances/9fe77732-86b7-4e9e-ac07-0eef8f9d1405_del complete
Nov 16 01:01:49 user nova-compute[75826]: INFO nova.compute.manager [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 16 01:01:49 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:01:49 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Took 0.42 seconds to deallocate network for instance.
Nov 16 01:01:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:01:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:50 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Deleted allocations for instance 9fe77732-86b7-4e9e-ac07-0eef8f9d1405
Nov 16 01:01:50 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Snapshot image upload complete
Nov 16 01:01:50 user nova-compute[75826]: INFO nova.compute.manager [None req-6183d59c-8956-4b7e-a768-53986798bd8a tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Took 5.46 seconds to snapshot the instance on the hypervisor.
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9f8f77d1-230f-4a37-9434-e4fd54c06942 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.856s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-b9d27934-9f97-48b9-b1e9-1a7f4994ea3b req-0880bbc0-ad1c-4d73-9640-cc6f0fc27452 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b9d27934-9f97-48b9-b1e9-1a7f4994ea3b req-0880bbc0-ad1c-4d73-9640-cc6f0fc27452 service nova] Acquiring lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b9d27934-9f97-48b9-b1e9-1a7f4994ea3b req-0880bbc0-ad1c-4d73-9640-cc6f0fc27452 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b9d27934-9f97-48b9-b1e9-1a7f4994ea3b req-0880bbc0-ad1c-4d73-9640-cc6f0fc27452 service nova] Lock "9fe77732-86b7-4e9e-ac07-0eef8f9d1405-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-b9d27934-9f97-48b9-b1e9-1a7f4994ea3b req-0880bbc0-ad1c-4d73-9640-cc6f0fc27452 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] No waiting events found dispatching network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:01:50 user nova-compute[75826]: WARNING nova.compute.manager [req-b9d27934-9f97-48b9-b1e9-1a7f4994ea3b req-0880bbc0-ad1c-4d73-9640-cc6f0fc27452 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received unexpected event network-vif-plugged-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 for instance with vm_state deleted and task_state None.
Nov 16 01:01:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-b9d27934-9f97-48b9-b1e9-1a7f4994ea3b req-0880bbc0-ad1c-4d73-9640-cc6f0fc27452 service nova] [instance: 9fe77732-86b7-4e9e-ac07-0eef8f9d1405] Received event network-vif-deleted-9891b7e5-c4e1-4202-ad4d-adbb33abfac6 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEQqdtUH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:01:50 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:01:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:01:50 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:01:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:01:50 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5989e88-a882-4fa8-a003-2c62234ba7e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 01:01:50 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3d7bedb-8084-44ab-8493-4ce7e9f68c68]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb] added
Nov 16 01:01:50 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f970c0c-1293-4970-ab8d-e86b4120eec8]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc5ec75-47b4-48b5-87c0-194968ac3c7e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEQqdtUH {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZEQqdtUH" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9a7604-ec78-48c1-838d-8de48f5e967e]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZEQqdtUH'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3638352b-8ee3-4c8b-9019-f1a5a3f5745c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:50 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c09b658-8eb6-476d-a339-72a92416aaff]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:01:51 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:01:51 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:01:51 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:01:51 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f438614f-3b34-40c7-9b25-2b4f0336e2a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb, portal: 172.16.0.220,3260]
Nov 16 01:01:51 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb, portal: 172.16.0.220,3260] successful.
Nov 16 01:01:51 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd9a852f-56ea-44cc-8273-e3c280ec0af5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[216d17ae-1796-40c7-aab0-fafc2129c16c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:01:51 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:01:51 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:01:51 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:01:51 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:01:51 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:01:51 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1151fad-5a99-452e-9852-cd6ae83e9e1e]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:01:51 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEQqdtUH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:01:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:01:52 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '26331363465396261', 'path': '/dev/sdd'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:01:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331363465396261', 'path': '/dev/sdd'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:01:52 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lazy-loading 'flavor' on Instance uuid 58c57f68-f803-4913-9f4b-0573a523c19e {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:01:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 01:01:52 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:01:52 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 01:01:52 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:01:52 user nova-compute[75826]:   <serial>369c56ae-c31e-48db-b49e-145a1f2e1acb</serial>
Nov 16 01:01:52 user nova-compute[75826]: </disk>
Nov 16 01:01:52 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 01:01:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:01:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:01:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] No VIF found with MAC fa:16:3e:f6:ec:4b, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:01:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d3dd6ef5-5f22-46b0-a605-cd83fc007b02 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.202s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "58c57f68-f803-4913-9f4b-0573a523c19e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG nova.objects.instance [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lazy-loading 'flavor' on Instance uuid 58c57f68-f803-4913-9f4b-0573a523c19e {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.083s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "58c57f68-f803-4913-9f4b-0573a523c19e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:01:56 user nova-compute[75826]: INFO nova.compute.manager [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Attaching volume 4f2214a8-b695-4806-af14-4ae24db38331 to /dev/vdc
Nov 16 01:01:56 user nova-compute[75826]: DEBUG os_brick.utils [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4cee83-bfa9-4d5e-a82e-4273e0495c35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d25bf6-5501-446c-af7e-235001e06426]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa8015f-be23-4dce-a3eb-7d873dc223f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebf20d4-831a-4b00-a8cb-8c034220ed22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:01:56 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 01:01:56 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a729b2-6192-4463-b999-577090c3bac9]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG os_brick.utils [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:01:56 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Updating existing volume attachment record: 8b641df8-a13a-48d0-b0e1-7cbb0af55719 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 01:01:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUWTHwoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:02:01 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:02:01 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:02:01 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bd5394-4b06-4d46-ac8c-eb72ab9f3206]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 01:02:01 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16369ed-22b1-48d3-8cf6-623b31453c86]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331] added
Nov 16 01:02:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ef6e76-c7ba-4233-b34b-591d2aa089c0]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e70ef89-66b4-45bb-b2ca-1dbf828f49ae]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUWTHwoP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cUWTHwoP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2213f18e-a1ab-47b3-a018-03252afa8849]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cUWTHwoP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4cc2b2-97a2-4612-89eb-888401ea4800]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e8a93f-6682-4bbe-9c5d-5bac4acb3c98]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:02:01 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:02:01 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:02:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:02:01 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:02:01 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:02:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c8aa0a-d695-47f4-a61a-a029e1ac5961]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331, portal: 172.16.0.220,3260]
Nov 16 01:02:01 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331, portal: 172.16.0.220,3260] successful.
Nov 16 01:02:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a82affc-13b4-481c-9135-80bddbdab213]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8eb9c3c-8fac-4e93-a21e-fb4d37fb24a3]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:02:01 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:02:01 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:02:01 user nova-compute[75826]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 (non-flash)
Nov 16 01:02:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:02:01 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:02:01 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:02:01 user nova-compute[75826]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 (non-flash)
Nov 16 01:02:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] HCTL ('36', '-', '-', 0) found on session 50 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:02:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:02 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:02 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fba407-fad6-4edd-b701-33b6f4304c76]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:02 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:02:02 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Searching for a device in session 50 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:02:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUWTHwoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:02:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:02:02 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '23965356134393866', 'path': '/dev/sde'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:02:02 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965356134393866', 'path': '/dev/sde'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:02:03 user nova-compute[75826]: DEBUG nova.objects.instance [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lazy-loading 'flavor' on Instance uuid 58c57f68-f803-4913-9f4b-0573a523c19e {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:02:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 01:02:03 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:02:03 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 01:02:03 user nova-compute[75826]:   <target dev="vdc" bus="virtio"/>
Nov 16 01:02:03 user nova-compute[75826]:   <serial>4f2214a8-b695-4806-af14-4ae24db38331</serial>
Nov 16 01:02:03 user nova-compute[75826]: </disk>
Nov 16 01:02:03 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 01:02:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:02:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:02:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:02:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] No VIF found with MAC fa:16:3e:f6:ec:4b, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:02:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f797e590-28a6-46ab-ba3f-8a2f4fb76ff6 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.184s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "58c57f68-f803-4913-9f4b-0573a523c19e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:04 user nova-compute[75826]: INFO nova.compute.manager [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Detaching volume 4f2214a8-b695-4806-af14-4ae24db38331
Nov 16 01:02:04 user nova-compute[75826]: INFO nova.virt.block_device [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Attempting to driver detach volume 4f2214a8-b695-4806-af14-4ae24db38331 from mountpoint /dev/vdc
Nov 16 01:02:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Attempting to detach device vdc from instance 58c57f68-f803-4913-9f4b-0573a523c19e from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 01:02:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:02:04 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:02:04 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 01:02:04 user nova-compute[75826]:   <target dev="vdc" bus="virtio"/>
Nov 16 01:02:04 user nova-compute[75826]:   <serial>4f2214a8-b695-4806-af14-4ae24db38331</serial>
Nov 16 01:02:04 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 01:02:04 user nova-compute[75826]: </disk>
Nov 16 01:02:04 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:02:04 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Successfully detached device vdc from instance 58c57f68-f803-4913-9f4b-0573a523c19e from the persistent domain config.
Nov 16 01:02:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 58c57f68-f803-4913-9f4b-0573a523c19e from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 01:02:04 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:02:04 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:02:04 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 01:02:04 user nova-compute[75826]:   <target dev="vdc" bus="virtio"/>
Nov 16 01:02:04 user nova-compute[75826]:   <serial>4f2214a8-b695-4806-af14-4ae24db38331</serial>
Nov 16 01:02:04 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 16 01:02:04 user nova-compute[75826]: </disk>
Nov 16 01:02:04 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:02:05 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 58c57f68-f803-4913-9f4b-0573a523c19e {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 01:02:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG nova.compute.manager [req-adb321f7-b9f9-4984-acf8-992e14fc8618 req-d117db9b-4526-4aff-9729-2255846b9708 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-changed-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG nova.compute.manager [req-adb321f7-b9f9-4984-acf8-992e14fc8618 req-d117db9b-4526-4aff-9729-2255846b9708 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Refreshing instance network info cache due to event network-changed-0a09127f-96b6-4230-b058-dc47030afba4. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-adb321f7-b9f9-4984-acf8-992e14fc8618 req-d117db9b-4526-4aff-9729-2255846b9708 service nova] Acquiring lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-adb321f7-b9f9-4984-acf8-992e14fc8618 req-d117db9b-4526-4aff-9729-2255846b9708 service nova] Acquired lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-adb321f7-b9f9-4984-acf8-992e14fc8618 req-d117db9b-4526-4aff-9729-2255846b9708 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Refreshing network info cache for port 0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-adb321f7-b9f9-4984-acf8-992e14fc8618 req-d117db9b-4526-4aff-9729-2255846b9708 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updated VIF entry in instance network info cache for port 0a09127f-96b6-4230-b058-dc47030afba4. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG nova.network.neutron [req-adb321f7-b9f9-4984-acf8-992e14fc8618 req-d117db9b-4526-4aff-9729-2255846b9708 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updating instance_info_cache with network_info: [{"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-adb321f7-b9f9-4984-acf8-992e14fc8618 req-d117db9b-4526-4aff-9729-2255846b9708 service nova] Releasing lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "f2aeb101-4454-4a86-9e77-9426c732d526" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:10 user nova-compute[75826]: INFO nova.compute.manager [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Detaching volume f426f6ce-2d00-41fe-a635-eda1d50bd16d
Nov 16 01:02:10 user nova-compute[75826]: INFO nova.virt.block_device [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Attempting to driver detach volume f426f6ce-2d00-41fe-a635-eda1d50bd16d from mountpoint /dev/vdb
Nov 16 01:02:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Attempting to detach device vdb from instance f2aeb101-4454-4a86-9e77-9426c732d526 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:02:10 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:02:10 user nova-compute[75826]:   <source dev="/dev/sdb"/>
Nov 16 01:02:10 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:02:10 user nova-compute[75826]:   <serial>f426f6ce-2d00-41fe-a635-eda1d50bd16d</serial>
Nov 16 01:02:10 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:02:10 user nova-compute[75826]: </disk>
Nov 16 01:02:10 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:02:10 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Successfully detached device vdb from instance f2aeb101-4454-4a86-9e77-9426c732d526 from the persistent domain config.
Nov 16 01:02:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f2aeb101-4454-4a86-9e77-9426c732d526 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:02:10 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:02:10 user nova-compute[75826]:   <source dev="/dev/sdb"/>
Nov 16 01:02:10 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:02:10 user nova-compute[75826]:   <serial>f426f6ce-2d00-41fe-a635-eda1d50bd16d</serial>
Nov 16 01:02:10 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:02:10 user nova-compute[75826]: </disk>
Nov 16 01:02:10 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:02:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f2aeb101-4454-4a86-9e77-9426c732d526 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 01:02:12 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:02:12 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:02:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-3dd87a71-1817-485c-a8ca-38d6792dc8fd req-9a7ea321-1eb3-42b9-acca-5bc1a72a137a service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-changed-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:02:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-3dd87a71-1817-485c-a8ca-38d6792dc8fd req-9a7ea321-1eb3-42b9-acca-5bc1a72a137a service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Refreshing instance network info cache due to event network-changed-0a09127f-96b6-4230-b058-dc47030afba4. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:02:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3dd87a71-1817-485c-a8ca-38d6792dc8fd req-9a7ea321-1eb3-42b9-acca-5bc1a72a137a service nova] Acquiring lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:02:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3dd87a71-1817-485c-a8ca-38d6792dc8fd req-9a7ea321-1eb3-42b9-acca-5bc1a72a137a service nova] Acquired lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:02:12 user nova-compute[75826]: DEBUG nova.network.neutron [req-3dd87a71-1817-485c-a8ca-38d6792dc8fd req-9a7ea321-1eb3-42b9-acca-5bc1a72a137a service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Refreshing network info cache for port 0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:02:12 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 01:02:12 user nova-compute[75826]: DEBUG nova.network.neutron [req-3dd87a71-1817-485c-a8ca-38d6792dc8fd req-9a7ea321-1eb3-42b9-acca-5bc1a72a137a service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updated VIF entry in instance network info cache for port 0a09127f-96b6-4230-b058-dc47030afba4. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:02:12 user nova-compute[75826]: DEBUG nova.network.neutron [req-3dd87a71-1817-485c-a8ca-38d6792dc8fd req-9a7ea321-1eb3-42b9-acca-5bc1a72a137a service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updating instance_info_cache with network_info: [{"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:02:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3dd87a71-1817-485c-a8ca-38d6792dc8fd req-9a7ea321-1eb3-42b9-acca-5bc1a72a137a service nova] Releasing lock "refresh_cache-f2aeb101-4454-4a86-9e77-9426c732d526" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:02:14 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:02:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:15 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:02:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG nova.compute.manager [req-a540a475-b328-44b9-9497-db96a666c87b req-18a3eaad-932b-4f99-b499-c2f6c3acbef1 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received event network-changed-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG nova.compute.manager [req-a540a475-b328-44b9-9497-db96a666c87b req-18a3eaad-932b-4f99-b499-c2f6c3acbef1 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Refreshing instance network info cache due to event network-changed-54b9a96a-3659-41b7-a654-9bfab1f475fd. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a540a475-b328-44b9-9497-db96a666c87b req-18a3eaad-932b-4f99-b499-c2f6c3acbef1 service nova] Acquiring lock "refresh_cache-8705a8fc-b910-45b0-9d54-12b525954bee" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a540a475-b328-44b9-9497-db96a666c87b req-18a3eaad-932b-4f99-b499-c2f6c3acbef1 service nova] Acquired lock "refresh_cache-8705a8fc-b910-45b0-9d54-12b525954bee" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG nova.network.neutron [req-a540a475-b328-44b9-9497-db96a666c87b req-18a3eaad-932b-4f99-b499-c2f6c3acbef1 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Refreshing network info cache for port 54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:02:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG nova.network.neutron [req-a540a475-b328-44b9-9497-db96a666c87b req-18a3eaad-932b-4f99-b499-c2f6c3acbef1 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Updated VIF entry in instance network info cache for port 54b9a96a-3659-41b7-a654-9bfab1f475fd. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG nova.network.neutron [req-a540a475-b328-44b9-9497-db96a666c87b req-18a3eaad-932b-4f99-b499-c2f6c3acbef1 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Updating instance_info_cache with network_info: [{"id": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "address": "fa:16:3e:a4:09:88", "network": {"id": "ad13eecf-14bf-4dab-85fa-eac1e5a6bc82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-369970053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00e572425d9b49da8def94110f3b583f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b9a96a-36", "ovs_interfaceid": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a540a475-b328-44b9-9497-db96a666c87b req-18a3eaad-932b-4f99-b499-c2f6c3acbef1 service nova] Releasing lock "refresh_cache-8705a8fc-b910-45b0-9d54-12b525954bee" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:02:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:21 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:02:21 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:02:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=8005MB free_disk=25.130146026611328GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance f2aeb101-4454-4a86-9e77-9426c732d526 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 58c57f68-f803-4913-9f4b-0573a523c19e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 8705a8fc-b910-45b0-9d54-12b525954bee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:02:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'flavor' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:22 user nova-compute[75826]: INFO nova.compute.manager [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Attaching volume 08e83167-0747-40ed-99eb-790eb8b56509 to /dev/vdb
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG os_brick.utils [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9d2c71-cff7-4c16-9629-a994f8144e92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[512a90b4-c7d3-4913-9c7d-047395007fa6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d689d20-6fc2-4bec-a523-1a7d09e75977]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbd38d0-f76b-4616-90c8-434cedeaa252]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:02:22 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 01:02:22 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d0f037c-8aff-4215-b1e6-2543659d678b]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG os_brick.utils [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:02:22 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Updating existing volume attachment record: 9b7a2240-fbbe-48cf-b8c2-bb89d173b459 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 01:02:24 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:02:24 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:02:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:25 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 58c57f68-f803-4913-9f4b-0573a523c19e is timed out.
Nov 16 01:02:25 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Successfully detached device vdc from instance 58c57f68-f803-4913-9f4b-0573a523c19e from the live domain config.
Nov 16 01:02:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cUWTHwoP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:02:25 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e26125-d207-4720-91db-07f3ebe23b88]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:02:25 user nova-compute[75826]: No targets found.
Nov 16 01:02:25 user nova-compute[75826]: iSNS:
Nov 16 01:02:25 user nova-compute[75826]: No targets found.
Nov 16 01:02:25 user nova-compute[75826]: STATIC:
Nov 16 01:02:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6
Nov 16 01:02:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:02:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:02:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb
Nov 16 01:02:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:02:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:02:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331
Nov 16 01:02:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:02:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:02:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d
Nov 16 01:02:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:02:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:02:25 user nova-compute[75826]: FIRMWARE:
Nov 16 01:02:25 user nova-compute[75826]: No targets found.
Nov 16 01:02:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:02:25 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:02:25 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5351b5e1-6aaa-40fb-9ce2-a8d6d6947a5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca295b25-863c-4709-bdfc-912e5fa7cee8]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:02:25 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:02:25 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:02:25 user nova-compute[75826]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 (non-flash)
Nov 16 01:02:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:02:25 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:02:25 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:02:25 user nova-compute[75826]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 (non-flash)
Nov 16 01:02:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd942e9870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331'): ({'sde'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Removing single pathed devices sde {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b54f02-17e2-48bc-9d43-ad9beed2ab60]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2675bbe-5c38-4a26-8c44-b68a98e9ddb2]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Flushing IO for device /dev/sde {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b9507e-ba3e-44cd-8df5-3188fc0250fd]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f19b82e-0f67-453b-a39d-88f63c63dd64]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb19238-2bdd-4ad0-b14b-2e5ddeb4d5c9]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e12480-18aa-44b0-a706-c04be9a644e6]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331, portal: 172.16.0.220,3260]
Nov 16 01:02:25 user nova-compute[75826]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331, portal: 172.16.0.220,3260] successful.
Nov 16 01:02:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f2214a8-b695-4806-af14-4ae24db38331 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e09980-468d-486e-9e6e-20f01126a945]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] <== disconnect_volume: return (338ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:02:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:02:26 user nova-compute[75826]: DEBUG nova.objects.instance [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lazy-loading 'flavor' on Instance uuid 58c57f68-f803-4913-9f4b-0573a523c19e {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:02:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-daeb1656-8090-4000-8d1d-47ae8f92d832 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.669s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGHTpINl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:02:27 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:02:27 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:02:27 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e89dbdf-9995-4efa-949a-5c84d0e80af6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 01:02:27 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[88905caf-2b72-431f-8d0d-088c011aa242]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509] added
Nov 16 01:02:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc598195-243b-40cb-bc4c-a1b825ae2227]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a45b1-9865-4397-bd6e-74ed30918f7a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGHTpINl {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LGHTpINl" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4619c47c-b335-4405-88e1-dafba06a2be5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LGHTpINl'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[332c408f-4328-4ad4-a787-11fcdc1835be]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[50036f74-6442-47df-859e-25228d74f2e7]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:02:27 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:02:27 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:02:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:02:27 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:02:27 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:02:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d733c906-df19-4280-8f6d-f45f7a1600f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509, portal: 172.16.0.220,3260]
Nov 16 01:02:27 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509, portal: 172.16.0.220,3260] successful.
Nov 16 01:02:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0cdb4d2-438d-4406-b8ca-622291db33b9]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2e4186-502d-4a18-8150-7d3ae1aa8aac]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:02:27 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:02:27 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:02:27 user nova-compute[75826]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 (non-flash)
Nov 16 01:02:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:02:27 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:02:27 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:02:27 user nova-compute[75826]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 (non-flash)
Nov 16 01:02:27 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] HCTL ('36', '-', '-', 0) found on session 51 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4962c6f-7e5d-49d5-8b88-a4ad99ee7d43]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:27 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:02:28 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:02:28 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Searching for a device in session 51 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:02:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGHTpINl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:02:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:02:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23765663332626436', 'path': '/dev/sde'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:02:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765663332626436', 'path': '/dev/sde'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:02:28 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'flavor' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:02:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 01:02:28 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:02:28 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 01:02:28 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:02:28 user nova-compute[75826]:   <serial>08e83167-0747-40ed-99eb-790eb8b56509</serial>
Nov 16 01:02:28 user nova-compute[75826]: </disk>
Nov 16 01:02:28 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 01:02:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:02:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:02:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No VIF found with MAC fa:16:3e:a4:09:88, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:02:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e92d2e00-8773-497d-ac37-f97078f7a78b tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.938s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:30 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f2aeb101-4454-4a86-9e77-9426c732d526 is timed out.
Nov 16 01:02:30 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Successfully detached device vdb from instance f2aeb101-4454-4a86-9e77-9426c732d526 from the live domain config.
Nov 16 01:02:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:02:30 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kMobynme', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:02:30 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:02:30 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:02:30 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:02:30 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d1f31f-a9a7-4418-bb65-99a05605141a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:02:31 user nova-compute[75826]: No targets found.
Nov 16 01:02:31 user nova-compute[75826]: iSNS:
Nov 16 01:02:31 user nova-compute[75826]: No targets found.
Nov 16 01:02:31 user nova-compute[75826]: STATIC:
Nov 16 01:02:31 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509
Nov 16 01:02:31 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:02:31 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:02:31 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6
Nov 16 01:02:31 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:02:31 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:02:31 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb
Nov 16 01:02:31 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:02:31 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:02:31 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d
Nov 16 01:02:31 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:02:31 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:02:31 user nova-compute[75826]: FIRMWARE:
Nov 16 01:02:31 user nova-compute[75826]: No targets found.
Nov 16 01:02:31 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:02:31 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:02:31 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[546fd362-bad6-4ca2-82d4-7414c2800bdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4435c3f0-2a8a-47d1-af78-9fdefc3507bb]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:02:31 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:02:31 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:02:31 user nova-compute[75826]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 (non-flash)
Nov 16 01:02:31 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d (non-flash)
Nov 16 01:02:31 user nova-compute[75826]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:02:31 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:02:31 user nova-compute[75826]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 (non-flash)
Nov 16 01:02:31 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd942eab90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d'): ({'sdb'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Removing single pathed devices sdb {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d24cba-26b4-4982-90c8-e2e9ec92e868]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bd69cd-73b9-4eff-919c-7fade6f27d6a]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Flushing IO for device /dev/sdb {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b166cc-32f2-4f65-97f4-37fa91724d72]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74a4e6b-85a7-4970-82cc-910e367b040f]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[de64b040-c6a6-44a1-9e60-9ae54ee3d670]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7096fd-3ddb-4673-8086-b78d27cd51df]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d, portal: 172.16.0.220,3260]
Nov 16 01:02:31 user nova-compute[75826]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d, portal: 172.16.0.220,3260] successful.
Nov 16 01:02:31 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f426f6ce-2d00-41fe-a635-eda1d50bd16d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[986c416a-6c50-419c-a436-91a356b117b7]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] <== disconnect_volume: return (335ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:02:31 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:02:32 user nova-compute[75826]: DEBUG nova.objects.instance [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'flavor' on Instance uuid f2aeb101-4454-4a86-9e77-9426c732d526 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:02:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e724d93-05b7-4dbf-bfe2-d7b4ab06ce08 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "f2aeb101-4454-4a86-9e77-9426c732d526" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.694s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:40 user nova-compute[75826]: INFO nova.compute.manager [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Detaching volume 08e83167-0747-40ed-99eb-790eb8b56509
Nov 16 01:02:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:40 user nova-compute[75826]: INFO nova.virt.block_device [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Attempting to driver detach volume 08e83167-0747-40ed-99eb-790eb8b56509 from mountpoint /dev/vdb
Nov 16 01:02:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Attempting to detach device vdb from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 01:02:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:02:40 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:02:40 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 01:02:40 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:02:40 user nova-compute[75826]:   <serial>08e83167-0747-40ed-99eb-790eb8b56509</serial>
Nov 16 01:02:40 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:02:40 user nova-compute[75826]: </disk>
Nov 16 01:02:40 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:02:40 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Successfully detached device vdb from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the persistent domain config.
Nov 16 01:02:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 01:02:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:02:40 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:02:40 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 01:02:40 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:02:40 user nova-compute[75826]:   <serial>08e83167-0747-40ed-99eb-790eb8b56509</serial>
Nov 16 01:02:40 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:02:40 user nova-compute[75826]: </disk>
Nov 16 01:02:40 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:02:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 01:02:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 01:02:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:42 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 01:02:42 user nova-compute[75826]: INFO nova.compute.claims [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Claim successful on node user
Nov 16 01:02:42 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:02:42 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:02:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 01:02:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 01:02:42 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 01:02:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 01:02:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 01:02:43 user nova-compute[75826]: DEBUG nova.policy [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '64aa8a18510d4d56b341f56cf8d5d3dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fa5ce9593fc4a4ea55228dd113781f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 01:02:43 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 01:02:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 01:02:43 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Creating image(s)
Nov 16 01:02:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "/opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "/opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "657a7197914ff57b393e1654d4a9a9cba35cfd8e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "657a7197914ff57b393e1654d4a9a9cba35cfd8e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e.part --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:43 user nova-compute[75826]: DEBUG nova.virt.images [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] 270819c2-4f92-42b4-a645-b94b0a23671c was qcow2, converting to raw {{(pid=75826) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 01:02:43 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 01:02:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e.part /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e.converted {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Successfully created port: 974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e.part /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e.converted" returned: 0 in 0.551s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e.converted --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "657a7197914ff57b393e1654d4a9a9cba35cfd8e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.326s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "657a7197914ff57b393e1654d4a9a9cba35cfd8e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "657a7197914ff57b393e1654d4a9a9cba35cfd8e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Successfully updated port: 974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquired lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-704fc998-8e20-4092-a6e5-312e7f3fcce6 req-72fdd1ca-1036-4c9b-84bc-26837727da98 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-changed-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-704fc998-8e20-4092-a6e5-312e7f3fcce6 req-72fdd1ca-1036-4c9b-84bc-26837727da98 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Refreshing instance network info cache due to event network-changed-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-704fc998-8e20-4092-a6e5-312e7f3fcce6 req-72fdd1ca-1036-4c9b-84bc-26837727da98 service nova] Acquiring lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e,backing_fmt=raw /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e,backing_fmt=raw /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk 1073741824" returned: 0 in 0.051s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "657a7197914ff57b393e1654d4a9a9cba35cfd8e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:44 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updating instance_info_cache with network_info: [{"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Releasing lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Instance network_info: |[{"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-704fc998-8e20-4092-a6e5-312e7f3fcce6 req-72fdd1ca-1036-4c9b-84bc-26837727da98 service nova] Acquired lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.network.neutron [req-704fc998-8e20-4092-a6e5-312e7f3fcce6 req-72fdd1ca-1036-4c9b-84bc-26837727da98 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Refreshing network info cache for port 974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Cannot resize image /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Ensure instance console log exists: /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Start _get_guest_xml network_info=[{"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T01:02:39Z,direct_url=<?>,disk_format='qcow2',id=270819c2-4f92-42b4-a645-b94b0a23671c,min_disk=0,min_ram=0,name='tempest-scenario-img--1940565767',owner='9fa5ce9593fc4a4ea55228dd113781f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T01:02:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '270819c2-4f92-42b4-a645-b94b0a23671c'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 01:02:45 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:02:45 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T01:02:39Z,direct_url=<?>,disk_format='qcow2',id=270819c2-4f92-42b4-a645-b94b0a23671c,min_disk=0,min_ram=0,name='tempest-scenario-img--1940565767',owner='9fa5ce9593fc4a4ea55228dd113781f1',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T01:02:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1038158312',display_name='tempest-TestMinimumBasicScenario-server-1038158312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1038158312',id=46,image_ref='270819c2-4f92-42b4-a645-b94b0a23671c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2oeMruFrtPEzFiL7816hKTl/j/Tv/58HnQs/PBG2c1SglwBBT12zyojcJA36l167JL3lM9sz4TvtSZmCAMvXIloS/t+R4G+Jixzk2gU16Hcb+bzs/Ae9qRTXO+PRMS1A==',key_name='tempest-TestMinimumBasicScenario-1069809059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fa5ce9593fc4a4ea55228dd113781f1',ramdisk_id='',reservation_id='r-d8npjbjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='270819c2-4f92-42b4-a645-b94b0a23671c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1996581904',owner_user_name='tempest-TestMinimumBasicScenario-1996581904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:02:43Z,user_data=None,user_id='64aa8a18510d4d56b341f56cf8d5d3dd',uuid=7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converting VIF {"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8a:2b,bridge_name='br-int',has_traffic_filtering=True,id=974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap974c93ce-d7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.objects.instance [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] End _get_guest_xml xml=<domain type="kvm">
Nov 16 01:02:45 user nova-compute[75826]:   <uuid>7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519</uuid>
Nov 16 01:02:45 user nova-compute[75826]:   <name>instance-0000002e</name>
Nov 16 01:02:45 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 01:02:45 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 01:02:45 user nova-compute[75826]:   <metadata>
Nov 16 01:02:45 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 01:02:45 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 01:02:45 user nova-compute[75826]:       <nova:name>tempest-TestMinimumBasicScenario-server-1038158312</nova:name>
Nov 16 01:02:45 user nova-compute[75826]:       <nova:creationTime>2023-11-16 01:02:45</nova:creationTime>
Nov 16 01:02:45 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 01:02:45 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 01:02:45 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 01:02:45 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 01:02:45 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 01:02:45 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 01:02:45 user nova-compute[75826]:       </nova:flavor>
Nov 16 01:02:45 user nova-compute[75826]:       <nova:owner>
Nov 16 01:02:45 user nova-compute[75826]:         <nova:user uuid="64aa8a18510d4d56b341f56cf8d5d3dd">tempest-TestMinimumBasicScenario-1996581904-project-member</nova:user>
Nov 16 01:02:45 user nova-compute[75826]:         <nova:project uuid="9fa5ce9593fc4a4ea55228dd113781f1">tempest-TestMinimumBasicScenario-1996581904</nova:project>
Nov 16 01:02:45 user nova-compute[75826]:       </nova:owner>
Nov 16 01:02:45 user nova-compute[75826]:       <nova:root type="image" uuid="270819c2-4f92-42b4-a645-b94b0a23671c"/>
Nov 16 01:02:45 user nova-compute[75826]:       <nova:ports>
Nov 16 01:02:45 user nova-compute[75826]:         <nova:port uuid="974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b">
Nov 16 01:02:45 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 01:02:45 user nova-compute[75826]:         </nova:port>
Nov 16 01:02:45 user nova-compute[75826]:       </nova:ports>
Nov 16 01:02:45 user nova-compute[75826]:     </nova:instance>
Nov 16 01:02:45 user nova-compute[75826]:   </metadata>
Nov 16 01:02:45 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 01:02:45 user nova-compute[75826]:     <system>
Nov 16 01:02:45 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 01:02:45 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 01:02:45 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 01:02:45 user nova-compute[75826]:       <entry name="serial">7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519</entry>
Nov 16 01:02:45 user nova-compute[75826]:       <entry name="uuid">7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519</entry>
Nov 16 01:02:45 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 01:02:45 user nova-compute[75826]:     </system>
Nov 16 01:02:45 user nova-compute[75826]:   </sysinfo>
Nov 16 01:02:45 user nova-compute[75826]:   <os>
Nov 16 01:02:45 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 01:02:45 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 01:02:45 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 01:02:45 user nova-compute[75826]:   </os>
Nov 16 01:02:45 user nova-compute[75826]:   <features>
Nov 16 01:02:45 user nova-compute[75826]:     <acpi/>
Nov 16 01:02:45 user nova-compute[75826]:     <apic/>
Nov 16 01:02:45 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 01:02:45 user nova-compute[75826]:   </features>
Nov 16 01:02:45 user nova-compute[75826]:   <clock offset="utc">
Nov 16 01:02:45 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 01:02:45 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 01:02:45 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 01:02:45 user nova-compute[75826]:   </clock>
Nov 16 01:02:45 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 01:02:45 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 01:02:45 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 01:02:45 user nova-compute[75826]:   </cpu>
Nov 16 01:02:45 user nova-compute[75826]:   <devices>
Nov 16 01:02:45 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 01:02:45 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 01:02:45 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk"/>
Nov 16 01:02:45 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 01:02:45 user nova-compute[75826]:     </disk>
Nov 16 01:02:45 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 01:02:45 user nova-compute[75826]:       <mac address="fa:16:3e:8d:8a:2b"/>
Nov 16 01:02:45 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:02:45 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 01:02:45 user nova-compute[75826]:       <target dev="tap974c93ce-d7"/>
Nov 16 01:02:45 user nova-compute[75826]:     </interface>
Nov 16 01:02:45 user nova-compute[75826]:     <serial type="pty">
Nov 16 01:02:45 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/console.log" append="off"/>
Nov 16 01:02:45 user nova-compute[75826]:     </serial>
Nov 16 01:02:45 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 01:02:45 user nova-compute[75826]:     <video>
Nov 16 01:02:45 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:02:45 user nova-compute[75826]:     </video>
Nov 16 01:02:45 user nova-compute[75826]:     <rng model="virtio">
Nov 16 01:02:45 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 01:02:45 user nova-compute[75826]:     </rng>
Nov 16 01:02:45 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 01:02:45 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 01:02:45 user nova-compute[75826]:       <stats period="10"/>
Nov 16 01:02:45 user nova-compute[75826]:     </memballoon>
Nov 16 01:02:45 user nova-compute[75826]:   </devices>
Nov 16 01:02:45 user nova-compute[75826]: </domain>
Nov 16 01:02:45 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1038158312',display_name='tempest-TestMinimumBasicScenario-server-1038158312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1038158312',id=46,image_ref='270819c2-4f92-42b4-a645-b94b0a23671c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2oeMruFrtPEzFiL7816hKTl/j/Tv/58HnQs/PBG2c1SglwBBT12zyojcJA36l167JL3lM9sz4TvtSZmCAMvXIloS/t+R4G+Jixzk2gU16Hcb+bzs/Ae9qRTXO+PRMS1A==',key_name='tempest-TestMinimumBasicScenario-1069809059',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9fa5ce9593fc4a4ea55228dd113781f1',ramdisk_id='',reservation_id='r-d8npjbjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='270819c2-4f92-42b4-a645-b94b0a23671c',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1996581904',owner_user_name='tempest-TestMinimumBasicScenario-1996581904-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:02:43Z,user_data=None,user_id='64aa8a18510d4d56b341f56cf8d5d3dd',uuid=7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converting VIF {"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8a:2b,bridge_name='br-int',has_traffic_filtering=True,id=974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap974c93ce-d7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG os_vif [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8a:2b,bridge_name='br-int',has_traffic_filtering=True,id=974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap974c93ce-d7') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd18b2aa6-70aa-5612-8c1b-427100914966', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap974c93ce-d7, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap974c93ce-d7, col_values=(('qos', UUID('f84c5125-9d5b-4656-a640-d483b55757a6')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap974c93ce-d7, col_values=(('external_ids', {'iface-id': '974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:8a:2b', 'vm-uuid': '7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:45 user nova-compute[75826]: INFO os_vif [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8a:2b,bridge_name='br-int',has_traffic_filtering=True,id=974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap974c93ce-d7')
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] No VIF found with MAC fa:16:3e:8d:8a:2b, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.network.neutron [req-704fc998-8e20-4092-a6e5-312e7f3fcce6 req-72fdd1ca-1036-4c9b-84bc-26837727da98 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updated VIF entry in instance network info cache for port 974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG nova.network.neutron [req-704fc998-8e20-4092-a6e5-312e7f3fcce6 req-72fdd1ca-1036-4c9b-84bc-26837727da98 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updating instance_info_cache with network_info: [{"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:02:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-704fc998-8e20-4092-a6e5-312e7f3fcce6 req-72fdd1ca-1036-4c9b-84bc-26837727da98 service nova] Releasing lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:02:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-e88b5641-7621-4987-8cbb-de01a4c8dd57 req-abcce249-79c4-44de-a53e-2a84ce5e5e99 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:02:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e88b5641-7621-4987-8cbb-de01a4c8dd57 req-abcce249-79c4-44de-a53e-2a84ce5e5e99 service nova] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e88b5641-7621-4987-8cbb-de01a4c8dd57 req-abcce249-79c4-44de-a53e-2a84ce5e5e99 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e88b5641-7621-4987-8cbb-de01a4c8dd57 req-abcce249-79c4-44de-a53e-2a84ce5e5e99 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-e88b5641-7621-4987-8cbb-de01a4c8dd57 req-abcce249-79c4-44de-a53e-2a84ce5e5e99 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] No waiting events found dispatching network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:02:46 user nova-compute[75826]: WARNING nova.compute.manager [req-e88b5641-7621-4987-8cbb-de01a4c8dd57 req-abcce249-79c4-44de-a53e-2a84ce5e5e99 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received unexpected event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b for instance with vm_state building and task_state spawning.
Nov 16 01:02:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:48 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 01:02:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 01:02:48 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Instance spawned successfully.
Nov 16 01:02:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 01:02:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:02:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:02:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:02:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:02:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:02:48 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:02:48 user nova-compute[75826]: INFO nova.compute.manager [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Took 5.70 seconds to spawn the instance on the hypervisor.
Nov 16 01:02:48 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:02:48 user nova-compute[75826]: INFO nova.compute.manager [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Took 6.37 seconds to build instance.
Nov 16 01:02:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9711b70f-f36a-4a2a-a007-1605a5a601f4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.512s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-1904236f-de2a-43ac-83d8-febf65a795e8 req-b06cf32a-7af8-4adc-9a5c-f07b0a59e0e6 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:02:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1904236f-de2a-43ac-83d8-febf65a795e8 req-b06cf32a-7af8-4adc-9a5c-f07b0a59e0e6 service nova] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1904236f-de2a-43ac-83d8-febf65a795e8 req-b06cf32a-7af8-4adc-9a5c-f07b0a59e0e6 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1904236f-de2a-43ac-83d8-febf65a795e8 req-b06cf32a-7af8-4adc-9a5c-f07b0a59e0e6 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:02:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-1904236f-de2a-43ac-83d8-febf65a795e8 req-b06cf32a-7af8-4adc-9a5c-f07b0a59e0e6 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] No waiting events found dispatching network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:02:48 user nova-compute[75826]: WARNING nova.compute.manager [req-1904236f-de2a-43ac-83d8-febf65a795e8 req-b06cf32a-7af8-4adc-9a5c-f07b0a59e0e6 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received unexpected event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b for instance with vm_state active and task_state None.
Nov 16 01:02:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "58c57f68-f803-4913-9f4b-0573a523c19e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:02:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:02:55 user nova-compute[75826]: INFO nova.compute.manager [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Detaching volume 369c56ae-c31e-48db-b49e-145a1f2e1acb
Nov 16 01:02:55 user nova-compute[75826]: INFO nova.virt.block_device [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Attempting to driver detach volume 369c56ae-c31e-48db-b49e-145a1f2e1acb from mountpoint /dev/vdb
Nov 16 01:02:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Attempting to detach device vdb from instance 58c57f68-f803-4913-9f4b-0573a523c19e from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 01:02:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:02:55 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:02:55 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 01:02:55 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:02:55 user nova-compute[75826]:   <serial>369c56ae-c31e-48db-b49e-145a1f2e1acb</serial>
Nov 16 01:02:55 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:02:55 user nova-compute[75826]: </disk>
Nov 16 01:02:55 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:02:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Successfully detached device vdb from instance 58c57f68-f803-4913-9f4b-0573a523c19e from the persistent domain config.
Nov 16 01:02:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 58c57f68-f803-4913-9f4b-0573a523c19e from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 01:02:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:02:55 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:02:55 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 01:02:55 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:02:55 user nova-compute[75826]:   <serial>369c56ae-c31e-48db-b49e-145a1f2e1acb</serial>
Nov 16 01:02:55 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:02:55 user nova-compute[75826]: </disk>
Nov 16 01:02:55 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:02:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:02:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:02:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:02:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:02:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:02:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 58c57f68-f803-4913-9f4b-0573a523c19e {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:00 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8705a8fc-b910-45b0-9d54-12b525954bee is timed out.
Nov 16 01:03:00 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Successfully detached device vdb from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the live domain config.
Nov 16 01:03:00 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LGHTpINl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:03:00 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d048dc0-8e8c-40ac-b172-85219b73d6be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:03:00 user nova-compute[75826]: No targets found.
Nov 16 01:03:00 user nova-compute[75826]: iSNS:
Nov 16 01:03:00 user nova-compute[75826]: No targets found.
Nov 16 01:03:00 user nova-compute[75826]: STATIC:
Nov 16 01:03:00 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509
Nov 16 01:03:00 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:03:00 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:03:00 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6
Nov 16 01:03:00 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:03:00 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:03:00 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb
Nov 16 01:03:00 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:03:00 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:03:00 user nova-compute[75826]: FIRMWARE:
Nov 16 01:03:00 user nova-compute[75826]: No targets found.
Nov 16 01:03:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:03:00 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:03:00 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7064175c-7a9e-43cf-8593-7bda2c4ca829]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5433f0d-1291-4273-be19-cccba934f556]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:03:00 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:03:00 user nova-compute[75826]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 (non-flash)
Nov 16 01:03:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:03:00 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:03:00 user nova-compute[75826]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 (non-flash)
Nov 16 01:03:00 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd943028c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509'): ({'sde'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Removing single pathed devices sde {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "f2aeb101-4454-4a86-9e77-9426c732d526" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:00 user nova-compute[75826]: INFO nova.compute.manager [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Terminating instance
Nov 16 01:03:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2bdc136-a562-4e6f-b07c-aca80256b4d5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9319096b-39a3-4c8d-b220-7ee619c671b9]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Flushing IO for device /dev/sde {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac32e06-b907-45fb-8a43-d6169b799ebd]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c20e0e-f203-403a-97b2-107245640d2a]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd96894-bd4e-4335-9c25-45d5cd01cd4a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:00 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a61af4-56b2-44a6-9729-513f60634680]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509, portal: 172.16.0.220,3260]
Nov 16 01:03:01 user nova-compute[75826]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509, portal: 172.16.0.220,3260] successful.
Nov 16 01:03:01 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:08e83167-0747-40ed-99eb-790eb8b56509 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[805e6456-594a-4160-a6e1-623918ffd534]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] <== disconnect_volume: return (368ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-1a500204-6ce4-40b1-86d9-366c22c20ea9 req-a4c50233-2313-499b-887d-c920c03ab389 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-unplugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1a500204-6ce4-40b1-86d9-366c22c20ea9 req-a4c50233-2313-499b-887d-c920c03ab389 service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1a500204-6ce4-40b1-86d9-366c22c20ea9 req-a4c50233-2313-499b-887d-c920c03ab389 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1a500204-6ce4-40b1-86d9-366c22c20ea9 req-a4c50233-2313-499b-887d-c920c03ab389 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-1a500204-6ce4-40b1-86d9-366c22c20ea9 req-a4c50233-2313-499b-887d-c920c03ab389 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-unplugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-1a500204-6ce4-40b1-86d9-366c22c20ea9 req-a4c50233-2313-499b-887d-c920c03ab389 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-unplugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:01 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Instance destroyed successfully.
Nov 16 01:03:01 user nova-compute[75826]: DEBUG nova.objects.instance [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'resources' on Instance uuid f2aeb101-4454-4a86-9e77-9426c732d526 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:56:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1931447064',display_name='tempest-ServerRescueNegativeTestJSON-server-1931447064',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1931447064',id=38,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAO+/aGa62dNPp9RH1R0Wypc9oWDJDToML3kI4x93EPcAtp7goSZTYKzM033CrSv1/iYvpRWEbP4rq0A7+uF0ZZLsb5opD9GCBDwqEXAOlP/s/mAZ00KZ8rAG94DsUIVTw==',key_name='tempest-keypair-1369388165',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:58:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c7dc71f0e2f439f9944bd7410db7e08',ramdisk_id='',reservation_id='r-oug3e018',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2102246851',owner_user_name='tempest-ServerRescueNegativeTestJSON-2102246851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:00:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='923da525ba264ea4bf770e3a66319655',uuid=f2aeb101-4454-4a86-9e77-9426c732d526,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converting VIF {"id": "0a09127f-96b6-4230-b058-dc47030afba4", "address": "fa:16:3e:b8:e9:47", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.148", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a09127f-96", "ovs_interfaceid": "0a09127f-96b6-4230-b058-dc47030afba4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:e9:47,bridge_name='br-int',has_traffic_filtering=True,id=0a09127f-96b6-4230-b058-dc47030afba4,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a09127f-96') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG os_vif [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:e9:47,bridge_name='br-int',has_traffic_filtering=True,id=0a09127f-96b6-4230-b058-dc47030afba4,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a09127f-96') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a09127f-96, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dad6dcb8-efbf-40fa-94f1-4c2cd077c25f) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:01 user nova-compute[75826]: INFO os_vif [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:e9:47,bridge_name='br-int',has_traffic_filtering=True,id=0a09127f-96b6-4230-b058-dc47030afba4,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a09127f-96')
Nov 16 01:03:01 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Deleting instance files /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526_del
Nov 16 01:03:01 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Deletion of /opt/stack/data/nova/instances/f2aeb101-4454-4a86-9e77-9426c732d526_del complete
Nov 16 01:03:01 user nova-compute[75826]: INFO nova.compute.manager [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 01:03:01 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG nova.objects.instance [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'flavor' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3ea4cb8f-536a-4282-a11b-23b2c414f8f7 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.842s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:02 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:03:02 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Took 0.90 seconds to deallocate network for instance.
Nov 16 01:03:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-ea6e0b1f-0206-44c7-a43b-db13f46eb220 req-a1732e1f-56b0-47f2-ba25-8d0f6f982f23 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-deleted-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:02 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:03:02 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:03:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:02 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Deleted allocations for instance f2aeb101-4454-4a86-9e77-9426c732d526
Nov 16 01:03:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3574a911-6a87-4d48-b096-f14d3bb4a728 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "f2aeb101-4454-4a86-9e77-9426c732d526" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.232s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-87b7c3d6-40c9-41c3-84ab-143b6de8185e req-6de93900-51a0-4994-9a4b-19405184c039 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87b7c3d6-40c9-41c3-84ab-143b6de8185e req-6de93900-51a0-4994-9a4b-19405184c039 service nova] Acquiring lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87b7c3d6-40c9-41c3-84ab-143b6de8185e req-6de93900-51a0-4994-9a4b-19405184c039 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-87b7c3d6-40c9-41c3-84ab-143b6de8185e req-6de93900-51a0-4994-9a4b-19405184c039 service nova] Lock "f2aeb101-4454-4a86-9e77-9426c732d526-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-87b7c3d6-40c9-41c3-84ab-143b6de8185e req-6de93900-51a0-4994-9a4b-19405184c039 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] No waiting events found dispatching network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:03:03 user nova-compute[75826]: WARNING nova.compute.manager [req-87b7c3d6-40c9-41c3-84ab-143b6de8185e req-6de93900-51a0-4994-9a4b-19405184c039 service nova] [instance: f2aeb101-4454-4a86-9e77-9426c732d526] Received unexpected event network-vif-plugged-0a09127f-96b6-4230-b058-dc47030afba4 for instance with vm_state deleted and task_state None.
Nov 16 01:03:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-1ce18f21-be3b-4d5f-9d84-003df56fa1f9 req-a9aac1b5-cb05-44c6-8dd1-a0fc54ffd6ee service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Received event network-changed-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-1ce18f21-be3b-4d5f-9d84-003df56fa1f9 req-a9aac1b5-cb05-44c6-8dd1-a0fc54ffd6ee service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Refreshing instance network info cache due to event network-changed-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1ce18f21-be3b-4d5f-9d84-003df56fa1f9 req-a9aac1b5-cb05-44c6-8dd1-a0fc54ffd6ee service nova] Acquiring lock "refresh_cache-b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1ce18f21-be3b-4d5f-9d84-003df56fa1f9 req-a9aac1b5-cb05-44c6-8dd1-a0fc54ffd6ee service nova] Acquired lock "refresh_cache-b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG nova.network.neutron [req-1ce18f21-be3b-4d5f-9d84-003df56fa1f9 req-a9aac1b5-cb05-44c6-8dd1-a0fc54ffd6ee service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Refreshing network info cache for port 2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG nova.network.neutron [req-1ce18f21-be3b-4d5f-9d84-003df56fa1f9 req-a9aac1b5-cb05-44c6-8dd1-a0fc54ffd6ee service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Updated VIF entry in instance network info cache for port 2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG nova.network.neutron [req-1ce18f21-be3b-4d5f-9d84-003df56fa1f9 req-a9aac1b5-cb05-44c6-8dd1-a0fc54ffd6ee service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Updating instance_info_cache with network_info: [{"id": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "address": "fa:16:3e:25:66:f4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2540b0a5-b8", "ovs_interfaceid": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1ce18f21-be3b-4d5f-9d84-003df56fa1f9 req-a9aac1b5-cb05-44c6-8dd1-a0fc54ffd6ee service nova] Releasing lock "refresh_cache-b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:11 user nova-compute[75826]: INFO nova.compute.manager [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Terminating instance
Nov 16 01:03:11 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:03:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-57ed5d46-972d-4bb6-8e9d-c66b96f61f75 req-bdbb6b4a-9599-4141-9b2d-491070c53d4d service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Received event network-vif-unplugged-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-57ed5d46-972d-4bb6-8e9d-c66b96f61f75 req-bdbb6b4a-9599-4141-9b2d-491070c53d4d service nova] Acquiring lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-57ed5d46-972d-4bb6-8e9d-c66b96f61f75 req-bdbb6b4a-9599-4141-9b2d-491070c53d4d service nova] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-57ed5d46-972d-4bb6-8e9d-c66b96f61f75 req-bdbb6b4a-9599-4141-9b2d-491070c53d4d service nova] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-57ed5d46-972d-4bb6-8e9d-c66b96f61f75 req-bdbb6b4a-9599-4141-9b2d-491070c53d4d service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] No waiting events found dispatching network-vif-unplugged-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-57ed5d46-972d-4bb6-8e9d-c66b96f61f75 req-bdbb6b4a-9599-4141-9b2d-491070c53d4d service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Received event network-vif-unplugged-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:03:12 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Instance destroyed successfully.
Nov 16 01:03:12 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lazy-loading 'resources' on Instance uuid b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:01:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1525736367',display_name='tempest-TestVolumeBootPattern-server-1525736367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1525736367',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm3ahxdyhMyQRGdodmVB4rNyVTsBs9l2wJPImRwyG338XqNyzGOLQ50rip2YKesURLjC0iv5HRzeJcmp1NyHE7ZZ5taylxF05FJcu5bUEFb8Cv7u/1iu868o42QyRdnsQ==',key_name='tempest-TestVolumeBootPattern-1182608151',keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:01:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-264mbu8y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:01:31Z,user_data=None,user_id='6c17265442bc48f9b6de5367e91096b2',uuid=b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "address": "fa:16:3e:25:66:f4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2540b0a5-b8", "ovs_interfaceid": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "address": "fa:16:3e:25:66:f4", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.138", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2540b0a5-b8", "ovs_interfaceid": "2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:66:f4,bridge_name='br-int',has_traffic_filtering=True,id=2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2540b0a5-b8') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_vif [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:66:f4,bridge_name='br-int',has_traffic_filtering=True,id=2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2540b0a5-b8') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2540b0a5-b8, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dddeab23-e117-4747-a4db-3abb83ad14b1) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:12 user nova-compute[75826]: INFO os_vif [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:66:f4,bridge_name='br-int',has_traffic_filtering=True,id=2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2540b0a5-b8')
Nov 16 01:03:12 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEiqpoGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:03:12 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b20430-04d7-45de-a601-a70eaed48aaa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:03:12 user nova-compute[75826]: No targets found.
Nov 16 01:03:12 user nova-compute[75826]: iSNS:
Nov 16 01:03:12 user nova-compute[75826]: No targets found.
Nov 16 01:03:12 user nova-compute[75826]: STATIC:
Nov 16 01:03:12 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6
Nov 16 01:03:12 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:03:12 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:03:12 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb
Nov 16 01:03:12 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:03:12 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:03:12 user nova-compute[75826]: FIRMWARE:
Nov 16 01:03:12 user nova-compute[75826]: No targets found.
Nov 16 01:03:12 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:03:12 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:03:12 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[33426fb1-8d42-400e-9d6d-663bf19cb846]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[624ea867-eb56-4f36-bc73-6d3605f80be3]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:03:12 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:03:12 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:03:12 user nova-compute[75826]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:03:12 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb45ed480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6'): ({'sdc'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Removing single pathed devices sdc {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c8e684-86cb-4e76-8aee-6b2d7bd71d71]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce15c7c-407a-4c96-9fd5-732cfaedb07c]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flushing IO for device /dev/sdc {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea59a9c-16cb-42a8-a0dc-1733b3d7f5e6]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b14559-2eff-4eed-841d-b9533e104a81]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_23f1effa', '/dev/disk/by-id/scsi-23862346362643562', '/dev/disk/by-id/scsi-1SCST_BIO23f1effa-8b4cbd5b2b3f672d') {{(pid=85991) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ae4efa-124e-4acd-8ec4-ec65e8d17bfb]: (4, None) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3db29a-159e-434f-afe5-13c9fe66fc3a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b579b77-6d9c-4bd4-b522-f385d33576ae]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260]
Nov 16 01:03:12 user nova-compute[75826]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260] successful.
Nov 16 01:03:12 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:12 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:13 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:13 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[43be096f-4398-4c99-a161-524a2202fa26]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:03:13 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== disconnect_volume: return (291ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:03:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:03:13 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Deleting instance files /opt/stack/data/nova/instances/b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b_del
Nov 16 01:03:13 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Deletion of /opt/stack/data/nova/instances/b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b_del complete
Nov 16 01:03:13 user nova-compute[75826]: INFO nova.compute.manager [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 16 01:03:13 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:03:13 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:03:13 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Skipping network cache update for instance because it is being deleted. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG nova.objects.instance [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lazy-loading 'info_cache' on Instance uuid 574817b0-a25c-4da1-9ce6-804008e8279c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-b0c1cfd0-196f-49ce-bccb-dcd84f998d1c req-97dd5bbf-e23c-409f-86b0-d64f15670483 service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Received event network-vif-plugged-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b0c1cfd0-196f-49ce-bccb-dcd84f998d1c req-97dd5bbf-e23c-409f-86b0-d64f15670483 service nova] Acquiring lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b0c1cfd0-196f-49ce-bccb-dcd84f998d1c req-97dd5bbf-e23c-409f-86b0-d64f15670483 service nova] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-b0c1cfd0-196f-49ce-bccb-dcd84f998d1c req-97dd5bbf-e23c-409f-86b0-d64f15670483 service nova] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-b0c1cfd0-196f-49ce-bccb-dcd84f998d1c req-97dd5bbf-e23c-409f-86b0-d64f15670483 service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] No waiting events found dispatching network-vif-plugged-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:03:14 user nova-compute[75826]: WARNING nova.compute.manager [req-b0c1cfd0-196f-49ce-bccb-dcd84f998d1c req-97dd5bbf-e23c-409f-86b0-d64f15670483 service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Received unexpected event network-vif-plugged-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c for instance with vm_state active and task_state deleting.
Nov 16 01:03:14 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:03:14 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Took 1.41 seconds to deallocate network for instance.
Nov 16 01:03:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-989d6b4b-6602-4608-acd5-e9c2581d7c63 req-3fe17594-e9cd-4a82-a858-8737f42ce117 service nova] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Received event network-vif-deleted-2540b0a5-b8dc-4cd9-9c9d-73797b7fc72c {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Updating instance_info_cache with network_info: [{"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-574817b0-a25c-4da1-9ce6-804008e8279c" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:03:14 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:15 user nova-compute[75826]: INFO nova.compute.manager [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b] Took 0.92 seconds to detach 1 volumes for instance.
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:03:15 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 58c57f68-f803-4913-9f4b-0573a523c19e is timed out.
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.229s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:15 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Successfully detached device vdb from instance 58c57f68-f803-4913-9f4b-0573a523c19e from the live domain config.
Nov 16 01:03:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZEQqdtUH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:03:15 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[db050aa2-1920-415f-99e7-48437ea5f5b4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:03:15 user nova-compute[75826]: No targets found.
Nov 16 01:03:15 user nova-compute[75826]: iSNS:
Nov 16 01:03:15 user nova-compute[75826]: No targets found.
Nov 16 01:03:15 user nova-compute[75826]: STATIC:
Nov 16 01:03:15 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb
Nov 16 01:03:15 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:03:15 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:03:15 user nova-compute[75826]: FIRMWARE:
Nov 16 01:03:15 user nova-compute[75826]: No targets found.
Nov 16 01:03:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:03:15 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:03:15 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:15 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Deleted allocations for instance b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d34c55b-bb45-4261-9479-5872cea04e4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[70085934-2b58-403e-943a-34ef91c59937]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:03:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb (non-flash)
Nov 16 01:03:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb42917e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb'): ({'sdd'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Removing single pathed devices sdd {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a79087-6700-4fb4-912c-1c0cf15c8e5f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c58dc92e-e492-4ddf-bc7b-0cb9255d2ab5 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "b380dd07-9dd9-43f2-ab0c-6876d0ed8a2b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.900s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bcaf1d-38e3-4a14-b7c7-0248d0951214]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Flushing IO for device /dev/sdd {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[431baac1-ffac-4d89-a2d0-203c574ab45c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f00a320-cb82-47c9-8ac4-d1e8f10acd55]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2653284f-e055-4d93-ac40-0cdff7cbd5cb]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b7c08c-9b19-4e3f-bab8-bff2857e1f78]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb, portal: 172.16.0.220,3260]
Nov 16 01:03:15 user nova-compute[75826]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb, portal: 172.16.0.220,3260] successful.
Nov 16 01:03:15 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:369c56ae-c31e-48db-b49e-145a1f2e1acb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3d56a6-707a-4aa0-8616-24e647505b87]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] <== disconnect_volume: return (297ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:03:15 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:03:16 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lazy-loading 'flavor' on Instance uuid 58c57f68-f803-4913-9f4b-0573a523c19e {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6afe6e4f-1358-43e9-8c64-7188d44a8e13 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.723s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:17 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:03:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:18 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:19 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:21 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:03:21 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:03:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=8209MB free_disk=25.098373413085938GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7d7971e0-c96d-4690-8a14-033f6dd35776 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 58c57f68-f803-4913-9f4b-0573a523c19e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 8705a8fc-b910-45b0-9d54-12b525954bee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:03:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:22 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:03:22 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:03:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:23 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:03:26 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:03:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:03:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:28 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:03:28 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:03:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG nova.objects.instance [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'flavor' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:33 user nova-compute[75826]: INFO nova.compute.manager [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Attaching volume fc299b4a-eb23-44d0-8c67-5050f903725e to /dev/vdb
Nov 16 01:03:33 user nova-compute[75826]: DEBUG os_brick.utils [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bbd7c7-bf5b-4b30-a225-f0e3cb07d1b4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[84712369-6c8b-498a-9b70-0ade99e12d24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[90744941-308b-4dcd-ab88-8685e6114884]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cfd804-c646-47f2-9f4e-853cb78d0918]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:03:33 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 01:03:33 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6f816c-a2c4-4e9c-83b2-c3ee87b56e9c]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG os_brick.utils [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:03:33 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Updating existing volume attachment record: 1db6e3c6-33e2-4b1d-befb-a66de9daa80e {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 01:03:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:35 user nova-compute[75826]: DEBUG nova.objects.instance [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lazy-loading 'flavor' on Instance uuid 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:35 user nova-compute[75826]: INFO nova.compute.manager [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Attaching volume 0f744fab-37e6-4927-9403-b124e39f48ec to /dev/vdb
Nov 16 01:03:35 user nova-compute[75826]: DEBUG os_brick.utils [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:03:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[23828015-7f83-4746-a541-bd81eba2d8f2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a21b04-0ed9-4f75-9c22-b28fa3ec98cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd2d32b-ed19-4a1c-ab42-e757242e9997]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e415d37-a950-4310-88e2-e77c0a86faef]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:03:36 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 01:03:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[150f0fa3-2a90-4aed-9ae7-b448bc0ae009]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG os_brick.utils [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:03:36 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updating existing volume attachment record: 33a1f5b8-944a-4ff2-862f-bb21338765b0 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 01:03:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drwkuOBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:03:38 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:03:38 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:03:38 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a258a4be-05e6-446f-a554-45751175934d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 01:03:38 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac9886d-c89a-4922-9e1a-6b701bf9488e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e] added
Nov 16 01:03:38 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e229c169-f216-4272-b591-1088b6058eb8]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b6d8d6-da83-4dc5-8786-1ae2fdbfe41f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v drwkuOBi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v drwkuOBi" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae05473a-4d59-4944-92f3-a5b98011433b]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'drwkuOBi'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e8763f-2393-405b-a2ee-0e209047e621]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb5532f-58c3-499e-a83b-4076585dce43]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 01:03:38 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 01:03:38 user nova-compute[75826]:  {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:03:38 user nova-compute[75826]: WARNING os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 01:03:38 user nova-compute[75826]: 
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[70128696-84ea-47cb-be0d-ec52fe1be7a5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e, portal: 172.16.0.220,3260]
Nov 16 01:03:38 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e, portal: 172.16.0.220,3260] successful.
Nov 16 01:03:38 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b16c824-2a1d-46c3-85cf-374624cf2350]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[05706857-06eb-49c7-9f88-16a8de6cb552]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)
Nov 16 01:03:38 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)
Nov 16 01:03:38 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[699c8366-79f0-4d89-bceb-8a6893b2d595]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:03:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drwkuOBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:03:39 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:03:39 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] <== connect_volume: return (1302ms) {'type': 'block', 'scsi_wwn': '23063363034386661', 'path': '/dev/sdb'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:03:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063363034386661', 'path': '/dev/sdb'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:03:39 user nova-compute[75826]: DEBUG nova.objects.instance [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'flavor' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 01:03:39 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:03:39 user nova-compute[75826]:   <source dev="/dev/sdb"/>
Nov 16 01:03:39 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:03:39 user nova-compute[75826]:   <serial>fc299b4a-eb23-44d0-8c67-5050f903725e</serial>
Nov 16 01:03:39 user nova-compute[75826]: </disk>
Nov 16 01:03:39 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No VIF found with MAC fa:16:3e:a4:09:88, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f5509784-3860-4494-89d9-6c379f753632 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.721s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJIbPaZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:03:40 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:03:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:03:40 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:03:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:03:40 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a1edd6-84ca-48aa-90c3-f4328ef3ed02]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 01:03:40 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b174af-a5d1-41e5-8fa1-d7bf630e2f5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec] added
Nov 16 01:03:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[41422a5e-8be2-428a-993c-49c14d1646ad]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5d33d3-3a58-45a0-99f5-53a43663b222]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJIbPaZC {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJIbPaZC" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[70644600-af69-4a2e-8c8d-b3299c7257e4]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vJIbPaZC'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b34e66-d9e3-4734-93d9-7d1b98cb865d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c237687-d0e3-44d3-8d49-2665b2724cc9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)
Nov 16 01:03:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)
Nov 16 01:03:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:03:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabb4df7-9b70-4b91-a06e-387d8c5ddeed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec, portal: 172.16.0.220,3260]
Nov 16 01:03:41 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec, portal: 172.16.0.220,3260] successful.
Nov 16 01:03:41 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fe3a79-5c2d-48f5-9588-66f44c824b18]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf325456-afa7-40fb-844a-13f70cbb09ab]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)
Nov 16 01:03:41 user nova-compute[75826]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:03:41 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)
Nov 16 01:03:41 user nova-compute[75826]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:03:41 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bcb64f-2619-4fbd-94c3-3e19a2f401e8]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:41 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJIbPaZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23564346532663239', 'path': '/dev/sdc'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564346532663239', 'path': '/dev/sdc'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG nova.objects.instance [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lazy-loading 'flavor' on Instance uuid 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 01:03:42 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:03:42 user nova-compute[75826]:   <source dev="/dev/sdc"/>
Nov 16 01:03:42 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:03:42 user nova-compute[75826]:   <serial>0f744fab-37e6-4927-9403-b124e39f48ec</serial>
Nov 16 01:03:42 user nova-compute[75826]: </disk>
Nov 16 01:03:42 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:42 user nova-compute[75826]: INFO nova.compute.manager [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Detaching volume fc299b4a-eb23-44d0-8c67-5050f903725e
Nov 16 01:03:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] No VIF found with MAC fa:16:3e:5d:2d:d0, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:03:42 user nova-compute[75826]: INFO nova.virt.block_device [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Attempting to driver detach volume fc299b4a-eb23-44d0-8c67-5050f903725e from mountpoint /dev/vdb
Nov 16 01:03:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Attempting to detach device vdb from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:03:42 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:03:42 user nova-compute[75826]:   <source dev="/dev/sdb"/>
Nov 16 01:03:42 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:03:42 user nova-compute[75826]:   <serial>fc299b4a-eb23-44d0-8c67-5050f903725e</serial>
Nov 16 01:03:42 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:03:42 user nova-compute[75826]: </disk>
Nov 16 01:03:42 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:03:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Successfully detached device vdb from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the persistent domain config.
Nov 16 01:03:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:03:42 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:03:42 user nova-compute[75826]:   <source dev="/dev/sdb"/>
Nov 16 01:03:42 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:03:42 user nova-compute[75826]:   <serial>fc299b4a-eb23-44d0-8c67-5050f903725e</serial>
Nov 16 01:03:42 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:03:42 user nova-compute[75826]: </disk>
Nov 16 01:03:42 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-35300cd6-6a60-4db6-a604-b194dc16b47b tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.811s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 01:03:43 user nova-compute[75826]: INFO nova.compute.manager [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Rescuing
Nov 16 01:03:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:03:43 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquired lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:03:43 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:03:44 user nova-compute[75826]: DEBUG nova.network.neutron [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updating instance_info_cache with network_info: [{"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:03:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Releasing lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:03:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-f4060065-106b-408d-a6fe-502392f0e90a req-dbab1e28-575c-430d-9ef7-06986b6b4c0a service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-unplugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f4060065-106b-408d-a6fe-502392f0e90a req-dbab1e28-575c-430d-9ef7-06986b6b4c0a service nova] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f4060065-106b-408d-a6fe-502392f0e90a req-dbab1e28-575c-430d-9ef7-06986b6b4c0a service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f4060065-106b-408d-a6fe-502392f0e90a req-dbab1e28-575c-430d-9ef7-06986b6b4c0a service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-f4060065-106b-408d-a6fe-502392f0e90a req-dbab1e28-575c-430d-9ef7-06986b6b4c0a service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] No waiting events found dispatching network-vif-unplugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:03:44 user nova-compute[75826]: WARNING nova.compute.manager [req-f4060065-106b-408d-a6fe-502392f0e90a req-dbab1e28-575c-430d-9ef7-06986b6b4c0a service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received unexpected event network-vif-unplugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d for instance with vm_state active and task_state rescuing.
Nov 16 01:03:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:45 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Instance destroyed successfully.
Nov 16 01:03:45 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Attempting a stable device rescue
Nov 16 01:03:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75826) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 16 01:03:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Instance directory exists: not creating {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 16 01:03:45 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Creating image(s)
Nov 16 01:03:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "/opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "/opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "/opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:45 user nova-compute[75826]: DEBUG nova.objects.instance [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lazy-loading 'trusted_certs' on Instance uuid 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "8ff4a7016e90f2363fe56df747712b57d9c54591" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "8ff4a7016e90f2363fe56df747712b57d9c54591" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:45 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591.part --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "58c57f68-f803-4913-9f4b-0573a523c19e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:46 user nova-compute[75826]: INFO nova.compute.manager [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Terminating instance
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.compute.manager [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591.part --force-share --output=json" returned: 0 in 0.189s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.images [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] 8a3eca90-7258-4ed9-b2c3-944652f246bb was qcow2, converting to raw {{(pid=75826) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.privsep.utils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75826) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591.part /opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591.converted {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-fe5f499b-e8c7-4abf-aec4-0732d85c4621 req-feb1dd2a-aa24-4085-b8d9-9e19b01d27e0 service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Received event network-vif-unplugged-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fe5f499b-e8c7-4abf-aec4-0732d85c4621 req-feb1dd2a-aa24-4085-b8d9-9e19b01d27e0 service nova] Acquiring lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fe5f499b-e8c7-4abf-aec4-0732d85c4621 req-feb1dd2a-aa24-4085-b8d9-9e19b01d27e0 service nova] Lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-fe5f499b-e8c7-4abf-aec4-0732d85c4621 req-feb1dd2a-aa24-4085-b8d9-9e19b01d27e0 service nova] Lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-fe5f499b-e8c7-4abf-aec4-0732d85c4621 req-feb1dd2a-aa24-4085-b8d9-9e19b01d27e0 service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] No waiting events found dispatching network-vif-unplugged-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-fe5f499b-e8c7-4abf-aec4-0732d85c4621 req-feb1dd2a-aa24-4085-b8d9-9e19b01d27e0 service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Received event network-vif-unplugged-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591.part /opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591.converted" returned: 0 in 0.234s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591.converted --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "8ff4a7016e90f2363fe56df747712b57d9c54591" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.403s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "8ff4a7016e90f2363fe56df747712b57d9c54591" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "8ff4a7016e90f2363fe56df747712b57d9c54591" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591 --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-8ffb4df0-0fb9-45e7-a4ae-42aa9933e627 req-54e82e6e-8ed5-4e2f-9d6d-47c0552a5595 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8ffb4df0-0fb9-45e7-a4ae-42aa9933e627 req-54e82e6e-8ed5-4e2f-9d6d-47c0552a5595 service nova] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8ffb4df0-0fb9-45e7-a4ae-42aa9933e627 req-54e82e6e-8ed5-4e2f-9d6d-47c0552a5595 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8ffb4df0-0fb9-45e7-a4ae-42aa9933e627 req-54e82e6e-8ed5-4e2f-9d6d-47c0552a5595 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.compute.manager [req-8ffb4df0-0fb9-45e7-a4ae-42aa9933e627 req-54e82e6e-8ed5-4e2f-9d6d-47c0552a5595 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] No waiting events found dispatching network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:03:46 user nova-compute[75826]: WARNING nova.compute.manager [req-8ffb4df0-0fb9-45e7-a4ae-42aa9933e627 req-54e82e6e-8ed5-4e2f-9d6d-47c0552a5595 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received unexpected event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d for instance with vm_state active and task_state rescuing.
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591 --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591,backing_fmt=raw /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.rescue {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591,backing_fmt=raw /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.rescue" returned: 0 in 0.051s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "8ff4a7016e90f2363fe56df747712b57d9c54591" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.objects.instance [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lazy-loading 'migration_context' on Instance uuid 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:46 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Instance destroyed successfully.
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.objects.instance [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lazy-loading 'resources' on Instance uuid 58c57f68-f803-4913-9f4b-0573a523c19e {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.objects.base [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Object Instance<0fdae035-f108-4ea2-a70d-aa31a0e8522f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Start _get_guest_xml network_info=[{"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "vif_mac": "fa:16:3e:5d:2d:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '8a3eca90-7258-4ed9-b2c3-944652f246bb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '33a1f5b8-944a-4ff2-862f-bb21338765b0', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJIbPaZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '0fdae035-f108-4ea2-a70d-aa31a0e8522f', 'attached_at': '', 'detached_at': '', 'volume_id': '0f744fab-37e6-4927-9403-b124e39f48ec', 'serial': '0f744fab-37e6-4927-9403-b124e39f48ec'}, 'boot_index': None, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.objects.instance [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lazy-loading 'resources' on Instance uuid 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:59:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-2054260231',display_name='tempest-TestServerVolumeAttachmentScenario-server-2054260231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-2054260231',id=43,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAWD51GOsxcurp2seN8WOl59qo/wmDinMP/7XRB/FwB2fTP/YtLgoQUCMIWkZq2zvbgDDMwCR6MDgBMEBta0/4FfpSDJmeiRi2ebmylfWfzSj4ltu6bF2yR03IkFFaCENg==',key_name='tempest-keypair-1667353561',keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:00:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19420df617844f17a0e95a0981e12885',ramdisk_id='',reservation_id='r-dattevtc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-2080812168',owner_user_name='tempest-TestServerVolumeAttachmentScenario-2080812168-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:00:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='feba48e8625343afbe69f1b108c1521b',uuid=58c57f68-f803-4913-9f4b-0573a523c19e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "address": "fa:16:3e:f6:ec:4b", "network": {"id": "4f1a960f-26cc-41c1-97e6-7b053aec17b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-743130817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19420df617844f17a0e95a0981e12885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf098d5e2-cd", "ovs_interfaceid": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Converting VIF {"id": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "address": "fa:16:3e:f6:ec:4b", "network": {"id": "4f1a960f-26cc-41c1-97e6-7b053aec17b9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-743130817-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19420df617844f17a0e95a0981e12885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf098d5e2-cd", "ovs_interfaceid": "f098d5e2-cd70-4e61-a01f-28a6970f5bd5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=f098d5e2-cd70-4e61-a01f-28a6970f5bd5,network=Network(4f1a960f-26cc-41c1-97e6-7b053aec17b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf098d5e2-cd') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG os_vif [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=f098d5e2-cd70-4e61-a01f-28a6970f5bd5,network=Network(4f1a960f-26cc-41c1-97e6-7b053aec17b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf098d5e2-cd') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.objects.base [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Object Instance<0fdae035-f108-4ea2-a70d-aa31a0e8522f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.objects.instance [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lazy-loading 'numa_topology' on Instance uuid 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf098d5e2-cd, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.objects.base [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Object Instance<0fdae035-f108-4ea2-a70d-aa31a0e8522f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12477a7b-6bc3-4247-bc13-d1146205e0f6) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:03:46 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:03:46 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:03:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.objects.instance [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lazy-loading 'vcpu_model' on Instance uuid 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:46 user nova-compute[75826]: INFO os_vif [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:ec:4b,bridge_name='br-int',has_traffic_filtering=True,id=f098d5e2-cd70-4e61-a01f-28a6970f5bd5,network=Network(4f1a960f-26cc-41c1-97e6-7b053aec17b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf098d5e2-cd')
Nov 16 01:03:46 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Deleting instance files /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e_del
Nov 16 01:03:46 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Deletion of /opt/stack/data/nova/instances/58c57f68-f803-4913-9f4b-0573a523c19e_del complete
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.objects.base [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Object Instance<0fdae035-f108-4ea2-a70d-aa31a0e8522f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJIbPaZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:03:46 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:03:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:03:46 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:03:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:03:46 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00bf0d3-26d0-4ecf-aeeb-2985e1a74b21]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = vJIbPaZC\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 16 01:03:46 user nova-compute[75826]: node.name = iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec
Nov 16 01:03:46 user nova-compute[75826]: node.tpgt = -1
Nov 16 01:03:46 user nova-compute[75826]: node.startup = automatic
Nov 16 01:03:46 user nova-compute[75826]: node.leading_login = No
Nov 16 01:03:46 user nova-compute[75826]: iface.iscsi_ifacename = default
Nov 16 01:03:46 user nova-compute[75826]: iface.net_ifacename = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.ipaddress = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.prefix_len = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.hwaddress = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.transport_name = tcp
Nov 16 01:03:46 user nova-compute[75826]: iface.initiatorname = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.state = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.vlan_id = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.vlan_priority = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.vlan_state = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.iface_num = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.mtu = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.port = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.bootproto = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.subnet_mask = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.gateway = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.dhcp_alt_client_id_state = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.dhcp_alt_client_id = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.dhcp_dns = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.dhcp_learn_iqn = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.dhcp_req_vendor_id_state = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.dhcp_vendor_id_state = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.dhcp_vendor_id = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.dhcp_slp_da = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.fragmentation = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.gratuitous_arp = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.incoming_forwarding = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.tos_state = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.tos = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.ttl = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.delayed_ack = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.tcp_nagle = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.tcp_wsf_state = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.tcp_wsf = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.tcp_timer_scale = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.tcp_timestamp = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.redirect = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.def_task_mgmt_timeout = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.header_digest = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.data_digest = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.immediate_data = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.initial_r2t = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.data_seq_inorder = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.data_pdu_inorder = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.erl = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.max_receive_data_len = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.first_burst_len = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.max_outstanding_r2t = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.max_burst_len = 0
Nov 16 01:03:46 user nova-compute[75826]: iface.chap_auth = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.bidi_chap = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.strict_login_compliance = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.discovery_auth = <empty>
Nov 16 01:03:46 user nova-compute[75826]: iface.discovery_logout = <empty>
Nov 16 01:03:46 user nova-compute[75826]: node.discovery_address = <empty>
Nov 16 01:03:46 user nova-compute[75826]: node.discovery_port = 0
Nov 16 01:03:46 user nova-compute[75826]: node.discovery_type = static
Nov 16 01:03:46 user nova-compute[75826]: node.session.initial_cmdsn = 0
Nov 16 01:03:46 user nova-compute[75826]: node.session.initial_login_retry_max = 8
Nov 16 01:03:46 user nova-compute[75826]: node.session.xmit_thread_priority = -20
Nov 16 01:03:46 user nova-compute[75826]: node.session.cmds_max = 128
Nov 16 01:03:46 user nova-compute[75826]: node.session.queue_depth = 32
Nov 16 01:03:46 user nova-compute[75826]: node.session.nr_sessions = 1
Nov 16 01:03:46 user nova-compute[75826]: node.session.auth.authmethod = CHAP
Nov 16 01:03:46 user nova-compute[75826]: node.session.auth.username = vJIbPaZC
Nov 16 01:03:46 user nova-compute[75826]: node.session.auth.password = ***
Nov 16 01:03:46 user nova-compute[75826]: node.session.auth.username_in = <empty>
Nov 16 01:03:46 user nova-compute[75826]: node.session.auth.password_in = <empty>
Nov 16 01:03:46 user nova-compute[75826]: node.session.auth.chap_algs = MD5
Nov 16 01:03:46 user nova-compute[75826]: node.session.timeo.replacement_timeout = 120
Nov 16 01:03:46 user nova-compute[75826]: node.session.err_timeo.abort_timeout = 15
Nov 16 01:03:46 user nova-compute[75826]: node.session.err_timeo.lu_reset_timeout = 30
Nov 16 01:03:46 user nova-compute[75826]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 16 01:03:46 user nova-compute[75826]: node.session.err_timeo.host_reset_timeout = 60
Nov 16 01:03:46 user nova-compute[75826]: node.session.iscsi.FastAbort = Yes
Nov 16 01:03:46 user nova-compute[75826]: node.session.iscsi.InitialR2T = No
Nov 16 01:03:46 user nova-compute[75826]: node.session.iscsi.ImmediateData = Yes
Nov 16 01:03:46 user nova-compute[75826]: node.session.iscsi.FirstBurstLength = 262144
Nov 16 01:03:46 user nova-compute[75826]: node.session.iscsi.MaxBurstLength = 16776192
Nov 16 01:03:46 user nova-compute[75826]: node.session.iscsi.DefaultTime2Retain = 0
Nov 16 01:03:46 user nova-compute[75826]: node.session.iscsi.DefaultTime2Wait = 2
Nov 16 01:03:46 user nova-compute[75826]: node.session.iscsi.MaxConnections = 1
Nov 16 01:03:46 user nova-compute[75826]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 16 01:03:46 user nova-compute[75826]: node.session.iscsi.ERL = 0
Nov 16 01:03:46 user nova-compute[75826]: node.session.scan = manual
Nov 16 01:03:46 user nova-compute[75826]: node.session.reopen_max = 0
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].address = 172.16.0.220
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].port = 3260
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].startup = manual
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].tcp.window_size = 524288
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].tcp.type_of_service = 0
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].timeo.logout_timeout = 15
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].timeo.login_timeout = 15
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].timeo.auth_timeout = 45
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].timeo.noop_out_interval = 5
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].timeo.noop_out_timeout = 5
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].iscsi.HeaderDigest = None
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].iscsi.DataDigest = None
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].iscsi.IFMarker = No
Nov 16 01:03:46 user nova-compute[75826]: node.conn[0].iscsi.OFMarker = No
Nov 16 01:03:46 user nova-compute[75826]: # END RECORD
Nov 16 01:03:46 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:46 user nova-compute[75826]: INFO nova.compute.manager [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Took 0.98 seconds to destroy the instance on the hypervisor.
Nov 16 01:03:46 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:03:46 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a502ae69-2fdc-44a9-8f42-85eeeb5f98f7]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26f8df4-5bbb-4733-a2aa-2db625f206ae]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJIbPaZC {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vJIbPaZC" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c59aa3-5a79-46bf-a764-14e651134417]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vJIbPaZC'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ddda5e-03e7-4f38-b27d-adbb9a0ac0da]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2778b1e2-ad94-4f5c-9cfe-a1f36ad4f7bb]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)
Nov 16 01:03:47 user nova-compute[75826]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:03:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)
Nov 16 01:03:47 user nova-compute[75826]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:03:47 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] HCTL ('34', '0', '0', 0) found on session 53 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9609f8-151f-4f3b-9f8c-32f64b214494]: (4, ('0 0 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Searching for a device in session 53 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJIbPaZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.172s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] <== connect_volume: return (174ms) {'type': 'block', 'scsi_wwn': '23564346532663239', 'path': '/dev/sdc'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23564346532663239', 'path': '/dev/sdc'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2098629411',display_name='tempest-ServerStableDeviceRescueTest-server-2098629411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2098629411',id=42,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJ49rcYlPu3AwbxNJbwyRMkBPACuPDXxnYanYtoYF2FYYgtFksOxLarA127kouUH5sYUE8xCpEXsRT8jFvSPd4lNUBJS0YkQFomGha4ZIFiABnTeNbLU8q0P5A5RSWTCw==',key_name='tempest-keypair-2011727660',keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:59:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6208d85f7b20490d88f6aab71cd1c1a1',ramdisk_id='',reservation_id='r-02brzyic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1527052191',owner_user_name='tempest-ServerStableDeviceRescueTest-1527052191-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:01:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c09974200c464b9e959d85a652545f5c',uuid=0fdae035-f108-4ea2-a70d-aa31a0e8522f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "vif_mac": "fa:16:3e:5d:2d:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Converting VIF {"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "vif_mac": "fa:16:3e:5d:2d:d0"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2d:d0,bridge_name='br-int',has_traffic_filtering=True,id=50cf91b8-33b8-4556-8bee-bb6565d7ef4d,network=Network(c361bb6e-88c9-49af-862e-91799c7b1ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50cf91b8-33') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.objects.instance [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lazy-loading 'pci_devices' on Instance uuid 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.objects.base [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Object Instance<0fdae035-f108-4ea2-a70d-aa31a0e8522f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 01:03:47 user nova-compute[75826]:   <uuid>0fdae035-f108-4ea2-a70d-aa31a0e8522f</uuid>
Nov 16 01:03:47 user nova-compute[75826]:   <name>instance-0000002a</name>
Nov 16 01:03:47 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 01:03:47 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 01:03:47 user nova-compute[75826]:   <metadata>
Nov 16 01:03:47 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 01:03:47 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 01:03:47 user nova-compute[75826]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2098629411</nova:name>
Nov 16 01:03:47 user nova-compute[75826]:       <nova:creationTime>2023-11-16 01:03:46</nova:creationTime>
Nov 16 01:03:47 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 01:03:47 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 01:03:47 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 01:03:47 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 01:03:47 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 01:03:47 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 01:03:47 user nova-compute[75826]:       </nova:flavor>
Nov 16 01:03:47 user nova-compute[75826]:       <nova:owner>
Nov 16 01:03:47 user nova-compute[75826]:         <nova:user uuid="c09974200c464b9e959d85a652545f5c">tempest-ServerStableDeviceRescueTest-1527052191-project-member</nova:user>
Nov 16 01:03:47 user nova-compute[75826]:         <nova:project uuid="6208d85f7b20490d88f6aab71cd1c1a1">tempest-ServerStableDeviceRescueTest-1527052191</nova:project>
Nov 16 01:03:47 user nova-compute[75826]:       </nova:owner>
Nov 16 01:03:47 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 01:03:47 user nova-compute[75826]:       <nova:ports>
Nov 16 01:03:47 user nova-compute[75826]:         <nova:port uuid="50cf91b8-33b8-4556-8bee-bb6565d7ef4d">
Nov 16 01:03:47 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 16 01:03:47 user nova-compute[75826]:         </nova:port>
Nov 16 01:03:47 user nova-compute[75826]:       </nova:ports>
Nov 16 01:03:47 user nova-compute[75826]:     </nova:instance>
Nov 16 01:03:47 user nova-compute[75826]:   </metadata>
Nov 16 01:03:47 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 01:03:47 user nova-compute[75826]:     <system>
Nov 16 01:03:47 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 01:03:47 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 01:03:47 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 01:03:47 user nova-compute[75826]:       <entry name="serial">0fdae035-f108-4ea2-a70d-aa31a0e8522f</entry>
Nov 16 01:03:47 user nova-compute[75826]:       <entry name="uuid">0fdae035-f108-4ea2-a70d-aa31a0e8522f</entry>
Nov 16 01:03:47 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 01:03:47 user nova-compute[75826]:     </system>
Nov 16 01:03:47 user nova-compute[75826]:   </sysinfo>
Nov 16 01:03:47 user nova-compute[75826]:   <os>
Nov 16 01:03:47 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 01:03:47 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 01:03:47 user nova-compute[75826]:   </os>
Nov 16 01:03:47 user nova-compute[75826]:   <features>
Nov 16 01:03:47 user nova-compute[75826]:     <acpi/>
Nov 16 01:03:47 user nova-compute[75826]:     <apic/>
Nov 16 01:03:47 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 01:03:47 user nova-compute[75826]:   </features>
Nov 16 01:03:47 user nova-compute[75826]:   <clock offset="utc">
Nov 16 01:03:47 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 01:03:47 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 01:03:47 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 01:03:47 user nova-compute[75826]:   </clock>
Nov 16 01:03:47 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 01:03:47 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 01:03:47 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 01:03:47 user nova-compute[75826]:   </cpu>
Nov 16 01:03:47 user nova-compute[75826]:   <devices>
Nov 16 01:03:47 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 01:03:47 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 01:03:47 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk"/>
Nov 16 01:03:47 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 01:03:47 user nova-compute[75826]:     </disk>
Nov 16 01:03:47 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 01:03:47 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:03:47 user nova-compute[75826]:       <source dev="/dev/sdc"/>
Nov 16 01:03:47 user nova-compute[75826]:       <target dev="vdb" bus="virtio"/>
Nov 16 01:03:47 user nova-compute[75826]:       <serial>0f744fab-37e6-4927-9403-b124e39f48ec</serial>
Nov 16 01:03:47 user nova-compute[75826]:     </disk>
Nov 16 01:03:47 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 01:03:47 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 01:03:47 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.rescue"/>
Nov 16 01:03:47 user nova-compute[75826]:       <target dev="vdc" bus="virtio"/>
Nov 16 01:03:47 user nova-compute[75826]:       <boot order="1"/>
Nov 16 01:03:47 user nova-compute[75826]:     </disk>
Nov 16 01:03:47 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 01:03:47 user nova-compute[75826]:       <mac address="fa:16:3e:5d:2d:d0"/>
Nov 16 01:03:47 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:03:47 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 01:03:47 user nova-compute[75826]:       <target dev="tap50cf91b8-33"/>
Nov 16 01:03:47 user nova-compute[75826]:     </interface>
Nov 16 01:03:47 user nova-compute[75826]:     <serial type="pty">
Nov 16 01:03:47 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/console.log" append="off"/>
Nov 16 01:03:47 user nova-compute[75826]:     </serial>
Nov 16 01:03:47 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 01:03:47 user nova-compute[75826]:     <video>
Nov 16 01:03:47 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:03:47 user nova-compute[75826]:     </video>
Nov 16 01:03:47 user nova-compute[75826]:     <rng model="virtio">
Nov 16 01:03:47 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 01:03:47 user nova-compute[75826]:     </rng>
Nov 16 01:03:47 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 01:03:47 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 01:03:47 user nova-compute[75826]:       <stats period="10"/>
Nov 16 01:03:47 user nova-compute[75826]:     </memballoon>
Nov 16 01:03:47 user nova-compute[75826]:   </devices>
Nov 16 01:03:47 user nova-compute[75826]: </domain>
Nov 16 01:03:47 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 01:03:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Instance destroyed successfully.
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] No VIF found with MAC fa:16:3e:5d:2d:d0, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:03:47 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Took 0.67 seconds to deallocate network for instance.
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:03:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:47 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Deleted allocations for instance 58c57f68-f803-4913-9f4b-0573a523c19e
Nov 16 01:03:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-23d21566-0ae1-4f24-91fd-02f1737d2768 tempest-TestServerVolumeAttachmentScenario-2080812168 tempest-TestServerVolumeAttachmentScenario-2080812168-project-member] Lock "58c57f68-f803-4913-9f4b-0573a523c19e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.077s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-f86e43b4-ed42-4dac-8fc2-055fb355d61f req-2f44f6ce-658f-4a22-b985-13d1cf12d0cb service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Received event network-vif-plugged-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f86e43b4-ed42-4dac-8fc2-055fb355d61f req-2f44f6ce-658f-4a22-b985-13d1cf12d0cb service nova] Acquiring lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f86e43b4-ed42-4dac-8fc2-055fb355d61f req-2f44f6ce-658f-4a22-b985-13d1cf12d0cb service nova] Lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f86e43b4-ed42-4dac-8fc2-055fb355d61f req-2f44f6ce-658f-4a22-b985-13d1cf12d0cb service nova] Lock "58c57f68-f803-4913-9f4b-0573a523c19e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-f86e43b4-ed42-4dac-8fc2-055fb355d61f req-2f44f6ce-658f-4a22-b985-13d1cf12d0cb service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] No waiting events found dispatching network-vif-plugged-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:03:48 user nova-compute[75826]: WARNING nova.compute.manager [req-f86e43b4-ed42-4dac-8fc2-055fb355d61f req-2f44f6ce-658f-4a22-b985-13d1cf12d0cb service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Received unexpected event network-vif-plugged-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 for instance with vm_state deleted and task_state None.
Nov 16 01:03:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-f86e43b4-ed42-4dac-8fc2-055fb355d61f req-2f44f6ce-658f-4a22-b985-13d1cf12d0cb service nova] [instance: 58c57f68-f803-4913-9f4b-0573a523c19e] Received event network-vif-deleted-f098d5e2-cd70-4e61-a01f-28a6970f5bd5 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-56d8f75c-f6dc-4564-8492-f1feec423fed req-a9ba9fc4-25e4-4123-a35f-cee6b49718fb service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-56d8f75c-f6dc-4564-8492-f1feec423fed req-a9ba9fc4-25e4-4123-a35f-cee6b49718fb service nova] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-56d8f75c-f6dc-4564-8492-f1feec423fed req-a9ba9fc4-25e4-4123-a35f-cee6b49718fb service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-56d8f75c-f6dc-4564-8492-f1feec423fed req-a9ba9fc4-25e4-4123-a35f-cee6b49718fb service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:48 user nova-compute[75826]: DEBUG nova.compute.manager [req-56d8f75c-f6dc-4564-8492-f1feec423fed req-a9ba9fc4-25e4-4123-a35f-cee6b49718fb service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] No waiting events found dispatching network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:03:48 user nova-compute[75826]: WARNING nova.compute.manager [req-56d8f75c-f6dc-4564-8492-f1feec423fed req-a9ba9fc4-25e4-4123-a35f-cee6b49718fb service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received unexpected event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d for instance with vm_state active and task_state rescuing.
Nov 16 01:03:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:50 user nova-compute[75826]: DEBUG nova.compute.manager [None req-9bcf914e-c2b3-4075-a487-5e455ff461d1 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:03:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-26369f73-fc76-4899-ae94-5012b0e89752 req-9b7f7daf-117b-4f8b-96f7-d4dcd00cb473 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-26369f73-fc76-4899-ae94-5012b0e89752 req-9b7f7daf-117b-4f8b-96f7-d4dcd00cb473 service nova] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-26369f73-fc76-4899-ae94-5012b0e89752 req-9b7f7daf-117b-4f8b-96f7-d4dcd00cb473 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-26369f73-fc76-4899-ae94-5012b0e89752 req-9b7f7daf-117b-4f8b-96f7-d4dcd00cb473 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-26369f73-fc76-4899-ae94-5012b0e89752 req-9b7f7daf-117b-4f8b-96f7-d4dcd00cb473 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] No waiting events found dispatching network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:03:50 user nova-compute[75826]: WARNING nova.compute.manager [req-26369f73-fc76-4899-ae94-5012b0e89752 req-9b7f7daf-117b-4f8b-96f7-d4dcd00cb473 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received unexpected event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d for instance with vm_state active and task_state rescuing.
Nov 16 01:03:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "7d7971e0-c96d-4690-8a14-033f6dd35776" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:59 user nova-compute[75826]: INFO nova.compute.manager [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Terminating instance
Nov 16 01:03:59 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-d19aa0b0-ca3b-40b6-ba22-6f26fb8f9588 req-a2f18584-a15b-4684-9d2c-a0b646321d88 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received event network-vif-unplugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d19aa0b0-ca3b-40b6-ba22-6f26fb8f9588 req-a2f18584-a15b-4684-9d2c-a0b646321d88 service nova] Acquiring lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d19aa0b0-ca3b-40b6-ba22-6f26fb8f9588 req-a2f18584-a15b-4684-9d2c-a0b646321d88 service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d19aa0b0-ca3b-40b6-ba22-6f26fb8f9588 req-a2f18584-a15b-4684-9d2c-a0b646321d88 service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-d19aa0b0-ca3b-40b6-ba22-6f26fb8f9588 req-a2f18584-a15b-4684-9d2c-a0b646321d88 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] No waiting events found dispatching network-vif-unplugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-d19aa0b0-ca3b-40b6-ba22-6f26fb8f9588 req-a2f18584-a15b-4684-9d2c-a0b646321d88 service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received event network-vif-unplugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:03:59 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Instance destroyed successfully.
Nov 16 01:03:59 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'resources' on Instance uuid 7d7971e0-c96d-4690-8a14-033f6dd35776 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:47:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1322313404',display_name='tempest-ServerRescueNegativeTestJSON-server-1322313404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1322313404',id=26,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:49:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c7dc71f0e2f439f9944bd7410db7e08',ramdisk_id='',reservation_id='r-40x83n17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2102246851',owner_user_name='tempest-ServerRescueNegativeTestJSON-2102246851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:49:52Z,user_data=None,user_id='923da525ba264ea4bf770e3a66319655',uuid=7d7971e0-c96d-4690-8a14-033f6dd35776,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converting VIF {"id": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "address": "fa:16:3e:53:8f:6d", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5d12fa2-7d", "ovs_interfaceid": "f5d12fa2-7d94-48c1-a16f-e7330a19ccef", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:8f:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5d12fa2-7d94-48c1-a16f-e7330a19ccef,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d12fa2-7d') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG os_vif [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:8f:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5d12fa2-7d94-48c1-a16f-e7330a19ccef,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d12fa2-7d') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5d12fa2-7d, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ca5df24-e1d6-4c37-ab18-c3702aeaff9a) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:03:59 user nova-compute[75826]: INFO os_vif [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:8f:6d,bridge_name='br-int',has_traffic_filtering=True,id=f5d12fa2-7d94-48c1-a16f-e7330a19ccef,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5d12fa2-7d')
Nov 16 01:03:59 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Deleting instance files /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776_del
Nov 16 01:03:59 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Deletion of /opt/stack/data/nova/instances/7d7971e0-c96d-4690-8a14-033f6dd35776_del complete
Nov 16 01:03:59 user nova-compute[75826]: INFO nova.compute.manager [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Took 0.68 seconds to destroy the instance on the hypervisor.
Nov 16 01:03:59 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:03:59 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:04:00 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:04:00 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Took 0.53 seconds to deallocate network for instance.
Nov 16 01:04:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:00 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:04:00 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:04:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:00 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Deleted allocations for instance 7d7971e0-c96d-4690-8a14-033f6dd35776
Nov 16 01:04:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d7f1e395-12f8-4d77-b070-186ab2bc0ba8 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.570s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-86e8897d-dc66-4583-bd6a-d4eefa8d890f req-b02b260d-a05f-4b7f-9f5c-6d788705965f service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received event network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-86e8897d-dc66-4583-bd6a-d4eefa8d890f req-b02b260d-a05f-4b7f-9f5c-6d788705965f service nova] Acquiring lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-86e8897d-dc66-4583-bd6a-d4eefa8d890f req-b02b260d-a05f-4b7f-9f5c-6d788705965f service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-86e8897d-dc66-4583-bd6a-d4eefa8d890f req-b02b260d-a05f-4b7f-9f5c-6d788705965f service nova] Lock "7d7971e0-c96d-4690-8a14-033f6dd35776-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-86e8897d-dc66-4583-bd6a-d4eefa8d890f req-b02b260d-a05f-4b7f-9f5c-6d788705965f service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] No waiting events found dispatching network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:04:01 user nova-compute[75826]: WARNING nova.compute.manager [req-86e8897d-dc66-4583-bd6a-d4eefa8d890f req-b02b260d-a05f-4b7f-9f5c-6d788705965f service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received unexpected event network-vif-plugged-f5d12fa2-7d94-48c1-a16f-e7330a19ccef for instance with vm_state deleted and task_state None.
Nov 16 01:04:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-86e8897d-dc66-4583-bd6a-d4eefa8d890f req-b02b260d-a05f-4b7f-9f5c-6d788705965f service nova] [instance: 7d7971e0-c96d-4690-8a14-033f6dd35776] Received event network-vif-deleted-f5d12fa2-7d94-48c1-a16f-e7330a19ccef {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:03 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8705a8fc-b910-45b0-9d54-12b525954bee is timed out.
Nov 16 01:04:03 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Successfully detached device vdb from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the live domain config.
Nov 16 01:04:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'drwkuOBi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:04:03 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead20e02-6c37-4a76-98cf-90d542152f23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:04:03 user nova-compute[75826]: No targets found.
Nov 16 01:04:03 user nova-compute[75826]: iSNS:
Nov 16 01:04:03 user nova-compute[75826]: No targets found.
Nov 16 01:04:03 user nova-compute[75826]: STATIC:
Nov 16 01:04:03 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec
Nov 16 01:04:03 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:04:03 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:04:03 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e
Nov 16 01:04:03 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:04:03 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:04:03 user nova-compute[75826]: FIRMWARE:
Nov 16 01:04:03 user nova-compute[75826]: No targets found.
Nov 16 01:04:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:04:03 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:04:03 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dd8ce6-a74c-4702-9d3a-e767ba910f39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e48feb-79ef-4d45-bb12-88b34bf5b4e6]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)
Nov 16 01:04:03 user nova-compute[75826]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e (non-flash)
Nov 16 01:04:03 user nova-compute[75826]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd946f2560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e'): ({'sdb'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Removing single pathed devices sdb {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[708e0c4b-b747-4acf-b7d2-10326c7b215b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6a42bf-54ee-4779-a5aa-d12ff8c2b8bc]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Flushing IO for device /dev/sdb {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a53980-e151-4abb-a720-a7d2a6e92382]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89b78f3-f960-4548-bf5c-b6029095e87e]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9918b53d-0a91-452b-9f3e-fca961d35ce8]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3718ad-dd76-4031-9c7d-7151456cd9aa]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e, portal: 172.16.0.220,3260]
Nov 16 01:04:03 user nova-compute[75826]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e, portal: 172.16.0.220,3260] successful.
Nov 16 01:04:03 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fc299b4a-eb23-44d0-8c67-5050f903725e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d0d408-9edd-4e11-afd1-f8f322bd47de]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] <== disconnect_volume: return (303ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 01:04:03 user nova-compute[75826]: INFO nova.compute.claims [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Claim successful on node user
Nov 16 01:04:03 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.280s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:03 user nova-compute[75826]: DEBUG nova.compute.manager [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG nova.compute.manager [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG nova.network.neutron [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 01:04:04 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 01:04:04 user nova-compute[75826]: DEBUG nova.compute.manager [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG nova.policy [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c17265442bc48f9b6de5367e91096b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4135693756414fb70826b0f1d9345c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 01:04:04 user nova-compute[75826]: INFO nova.virt.block_device [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Booting with volume b37fc46e-6c9d-45a0-93b9-9182c0453ff6 at /dev/vda
Nov 16 01:04:04 user nova-compute[75826]: DEBUG nova.objects.instance [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'flavor' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG os_brick.utils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-830c71e8-9c19-4abd-92d4-e63f29214188 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.680s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e59fec0-0adc-4028-8f76-724268bce090]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf6e75b-77b4-42ac-afa9-50f94d231bb3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[263777a8-3a6d-4d9c-aff2-8a56ffd567f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e50930-fa86-4073-8ecb-6d638a016964]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:04:04 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 01:04:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcc42de-4164-42f7-872d-7b770ac65e1e]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG os_brick.utils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Updating existing volume attachment record: 98a534da-9acb-4b96-bdce-8955fae78500 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:04 user nova-compute[75826]: DEBUG nova.network.neutron [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Successfully created port: 3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Successfully updated port: 3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquired lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e52eb6d-1bd7-4cd0-9ec7-c8bdb4540dc8 req-de40b5e8-a3c6-47f5-aa8b-c342cff54ca8 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-changed-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG nova.compute.manager [req-9e52eb6d-1bd7-4cd0-9ec7-c8bdb4540dc8 req-de40b5e8-a3c6-47f5-aa8b-c342cff54ca8 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Refreshing instance network info cache due to event network-changed-3741ee96-4a17-46ef-91af-83a9fdb711b3. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e52eb6d-1bd7-4cd0-9ec7-c8bdb4540dc8 req-de40b5e8-a3c6-47f5-aa8b-c342cff54ca8 service nova] Acquiring lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Updating instance_info_cache with network_info: [{"id": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "address": "fa:16:3e:e6:4b:6e", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3741ee96-4a", "ovs_interfaceid": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Releasing lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG nova.compute.manager [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Instance network_info: |[{"id": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "address": "fa:16:3e:e6:4b:6e", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3741ee96-4a", "ovs_interfaceid": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e52eb6d-1bd7-4cd0-9ec7-c8bdb4540dc8 req-de40b5e8-a3c6-47f5-aa8b-c342cff54ca8 service nova] Acquired lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:04:05 user nova-compute[75826]: DEBUG nova.network.neutron [req-9e52eb6d-1bd7-4cd0-9ec7-c8bdb4540dc8 req-de40b5e8-a3c6-47f5-aa8b-c342cff54ca8 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Refreshing network info cache for port 3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:04:06 user nova-compute[75826]: DEBUG nova.network.neutron [req-9e52eb6d-1bd7-4cd0-9ec7-c8bdb4540dc8 req-de40b5e8-a3c6-47f5-aa8b-c342cff54ca8 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Updated VIF entry in instance network info cache for port 3741ee96-4a17-46ef-91af-83a9fdb711b3. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:04:06 user nova-compute[75826]: DEBUG nova.network.neutron [req-9e52eb6d-1bd7-4cd0-9ec7-c8bdb4540dc8 req-de40b5e8-a3c6-47f5-aa8b-c342cff54ca8 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Updating instance_info_cache with network_info: [{"id": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "address": "fa:16:3e:e6:4b:6e", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3741ee96-4a", "ovs_interfaceid": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:04:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9e52eb6d-1bd7-4cd0-9ec7-c8bdb4540dc8 req-de40b5e8-a3c6-47f5-aa8b-c342cff54ca8 service nova] Releasing lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 01:04:09 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Creating image(s)
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Ensure instance console log exists: /opt/stack/data/nova/instances/e39ea0c5-98bb-4a7f-acca-2812445d0d46/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Start _get_guest_xml network_info=[{"id": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "address": "fa:16:3e:e6:4b:6e", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3741ee96-4a", "ovs_interfaceid": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '98a534da-9acb-4b96-bdce-8955fae78500', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEiqpoGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e39ea0c5-98bb-4a7f-acca-2812445d0d46', 'attached_at': '', 'detached_at': '', 'volume_id': 'b37fc46e-6c9d-45a0-93b9-9182c0453ff6', 'serial': 'b37fc46e-6c9d-45a0-93b9-9182c0453ff6'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 01:04:09 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:04:09 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEiqpoGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:04:09 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:04:09 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:04:09 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d47f89-2c42-4d99-9b90-5e1a180287cf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 01:04:09 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4a2a55-df5e-4458-8bc6-8a25f7fab336]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6] added
Nov 16 01:04:09 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[32203c0c-8e19-470f-a06d-05a7c9f83434]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe9ead0-06e4-4b6b-be80-c4f87f5b8e88]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEiqpoGe {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEiqpoGe" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0f5fe2-e9bd-4ae2-a013-38966b97aa75]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aEiqpoGe'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e71aadd-8834-4f4c-9740-b4ae3f5ab26c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1651b0d8-3e2c-436e-9f07-23663ceb7faa]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:09 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:09 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d048b5-4c67-4050-a8cc-5d1b3a5c2c6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260]
Nov 16 01:04:09 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260] successful.
Nov 16 01:04:09 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[489b7a7c-672b-48c7-a7bb-74b21edc9847]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f85ac58-e86e-439a-b4fc-a6e514159068]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:09 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:04:09 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:09 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:04:09 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f9395a-574a-4bda-93bc-ffa63f4638c7]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEiqpoGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:04:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23862346362643562', 'path': '/dev/sdb'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862346362643562', 'path': '/dev/sdb'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-309470699',display_name='tempest-TestVolumeBootPattern-server-309470699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-309470699',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm3ahxdyhMyQRGdodmVB4rNyVTsBs9l2wJPImRwyG338XqNyzGOLQ50rip2YKesURLjC0iv5HRzeJcmp1NyHE7ZZ5taylxF05FJcu5bUEFb8Cv7u/1iu868o42QyRdnsQ==',key_name='tempest-TestVolumeBootPattern-1182608151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-p74mqspl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:04:04Z,user_data=None,user_id='6c17265442bc48f9b6de5367e91096b2',uuid=e39ea0c5-98bb-4a7f-acca-2812445d0d46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "address": "fa:16:3e:e6:4b:6e", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3741ee96-4a", "ovs_interfaceid": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "address": "fa:16:3e:e6:4b:6e", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3741ee96-4a", "ovs_interfaceid": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4b:6e,bridge_name='br-int',has_traffic_filtering=True,id=3741ee96-4a17-46ef-91af-83a9fdb711b3,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3741ee96-4a') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG nova.objects.instance [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lazy-loading 'pci_devices' on Instance uuid e39ea0c5-98bb-4a7f-acca-2812445d0d46 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] End _get_guest_xml xml=<domain type="kvm">
Nov 16 01:04:10 user nova-compute[75826]:   <uuid>e39ea0c5-98bb-4a7f-acca-2812445d0d46</uuid>
Nov 16 01:04:10 user nova-compute[75826]:   <name>instance-0000002f</name>
Nov 16 01:04:10 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 01:04:10 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 01:04:10 user nova-compute[75826]:   <metadata>
Nov 16 01:04:10 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 01:04:10 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 01:04:10 user nova-compute[75826]:       <nova:name>tempest-TestVolumeBootPattern-server-309470699</nova:name>
Nov 16 01:04:10 user nova-compute[75826]:       <nova:creationTime>2023-11-16 01:04:09</nova:creationTime>
Nov 16 01:04:10 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 01:04:10 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 01:04:10 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 01:04:10 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 01:04:10 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 01:04:10 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 01:04:10 user nova-compute[75826]:       </nova:flavor>
Nov 16 01:04:10 user nova-compute[75826]:       <nova:owner>
Nov 16 01:04:10 user nova-compute[75826]:         <nova:user uuid="6c17265442bc48f9b6de5367e91096b2">tempest-TestVolumeBootPattern-2108626012-project-member</nova:user>
Nov 16 01:04:10 user nova-compute[75826]:         <nova:project uuid="ef4135693756414fb70826b0f1d9345c">tempest-TestVolumeBootPattern-2108626012</nova:project>
Nov 16 01:04:10 user nova-compute[75826]:       </nova:owner>
Nov 16 01:04:10 user nova-compute[75826]:       <nova:ports>
Nov 16 01:04:10 user nova-compute[75826]:         <nova:port uuid="3741ee96-4a17-46ef-91af-83a9fdb711b3">
Nov 16 01:04:10 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 01:04:10 user nova-compute[75826]:         </nova:port>
Nov 16 01:04:10 user nova-compute[75826]:       </nova:ports>
Nov 16 01:04:10 user nova-compute[75826]:     </nova:instance>
Nov 16 01:04:10 user nova-compute[75826]:   </metadata>
Nov 16 01:04:10 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 01:04:10 user nova-compute[75826]:     <system>
Nov 16 01:04:10 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 01:04:10 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 01:04:10 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 01:04:10 user nova-compute[75826]:       <entry name="serial">e39ea0c5-98bb-4a7f-acca-2812445d0d46</entry>
Nov 16 01:04:10 user nova-compute[75826]:       <entry name="uuid">e39ea0c5-98bb-4a7f-acca-2812445d0d46</entry>
Nov 16 01:04:10 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 01:04:10 user nova-compute[75826]:     </system>
Nov 16 01:04:10 user nova-compute[75826]:   </sysinfo>
Nov 16 01:04:10 user nova-compute[75826]:   <os>
Nov 16 01:04:10 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 01:04:10 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 01:04:10 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 01:04:10 user nova-compute[75826]:   </os>
Nov 16 01:04:10 user nova-compute[75826]:   <features>
Nov 16 01:04:10 user nova-compute[75826]:     <acpi/>
Nov 16 01:04:10 user nova-compute[75826]:     <apic/>
Nov 16 01:04:10 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 01:04:10 user nova-compute[75826]:   </features>
Nov 16 01:04:10 user nova-compute[75826]:   <clock offset="utc">
Nov 16 01:04:10 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 01:04:10 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 01:04:10 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 01:04:10 user nova-compute[75826]:   </clock>
Nov 16 01:04:10 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 01:04:10 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 01:04:10 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 01:04:10 user nova-compute[75826]:   </cpu>
Nov 16 01:04:10 user nova-compute[75826]:   <devices>
Nov 16 01:04:10 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 01:04:10 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:04:10 user nova-compute[75826]:       <source dev="/dev/sdb"/>
Nov 16 01:04:10 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 01:04:10 user nova-compute[75826]:       <serial>b37fc46e-6c9d-45a0-93b9-9182c0453ff6</serial>
Nov 16 01:04:10 user nova-compute[75826]:     </disk>
Nov 16 01:04:10 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 01:04:10 user nova-compute[75826]:       <mac address="fa:16:3e:e6:4b:6e"/>
Nov 16 01:04:10 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:04:10 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 01:04:10 user nova-compute[75826]:       <target dev="tap3741ee96-4a"/>
Nov 16 01:04:10 user nova-compute[75826]:     </interface>
Nov 16 01:04:10 user nova-compute[75826]:     <serial type="pty">
Nov 16 01:04:10 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/e39ea0c5-98bb-4a7f-acca-2812445d0d46/console.log" append="off"/>
Nov 16 01:04:10 user nova-compute[75826]:     </serial>
Nov 16 01:04:10 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 01:04:10 user nova-compute[75826]:     <video>
Nov 16 01:04:10 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:04:10 user nova-compute[75826]:     </video>
Nov 16 01:04:10 user nova-compute[75826]:     <rng model="virtio">
Nov 16 01:04:10 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 01:04:10 user nova-compute[75826]:     </rng>
Nov 16 01:04:10 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 01:04:10 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 01:04:10 user nova-compute[75826]:       <stats period="10"/>
Nov 16 01:04:10 user nova-compute[75826]:     </memballoon>
Nov 16 01:04:10 user nova-compute[75826]:   </devices>
Nov 16 01:04:10 user nova-compute[75826]: </domain>
Nov 16 01:04:10 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-309470699',display_name='tempest-TestVolumeBootPattern-server-309470699',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-309470699',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm3ahxdyhMyQRGdodmVB4rNyVTsBs9l2wJPImRwyG338XqNyzGOLQ50rip2YKesURLjC0iv5HRzeJcmp1NyHE7ZZ5taylxF05FJcu5bUEFb8Cv7u/1iu868o42QyRdnsQ==',key_name='tempest-TestVolumeBootPattern-1182608151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-p74mqspl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:04:04Z,user_data=None,user_id='6c17265442bc48f9b6de5367e91096b2',uuid=e39ea0c5-98bb-4a7f-acca-2812445d0d46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "address": "fa:16:3e:e6:4b:6e", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3741ee96-4a", "ovs_interfaceid": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "address": "fa:16:3e:e6:4b:6e", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3741ee96-4a", "ovs_interfaceid": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4b:6e,bridge_name='br-int',has_traffic_filtering=True,id=3741ee96-4a17-46ef-91af-83a9fdb711b3,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3741ee96-4a') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG os_vif [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4b:6e,bridge_name='br-int',has_traffic_filtering=True,id=3741ee96-4a17-46ef-91af-83a9fdb711b3,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3741ee96-4a') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32f9d9d0-16b0-526c-9903-8ebf6e242dd7', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3741ee96-4a, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3741ee96-4a, col_values=(('qos', UUID('55958e83-ad41-46e2-9c67-6d3e900157eb')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3741ee96-4a, col_values=(('external_ids', {'iface-id': '3741ee96-4a17-46ef-91af-83a9fdb711b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:4b:6e', 'vm-uuid': 'e39ea0c5-98bb-4a7f-acca-2812445d0d46'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:10 user nova-compute[75826]: INFO os_vif [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:4b:6e,bridge_name='br-int',has_traffic_filtering=True,id=3741ee96-4a17-46ef-91af-83a9fdb711b3,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3741ee96-4a')
Nov 16 01:04:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:04:10 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] No VIF found with MAC fa:16:3e:e6:4b:6e, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:04:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-a97f43f4-ed3d-4f53-baf1-7cdc624ead12 req-98f77ff5-6593-4088-a1b5-e4ab2de8a7ce service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a97f43f4-ed3d-4f53-baf1-7cdc624ead12 req-98f77ff5-6593-4088-a1b5-e4ab2de8a7ce service nova] Acquiring lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a97f43f4-ed3d-4f53-baf1-7cdc624ead12 req-98f77ff5-6593-4088-a1b5-e4ab2de8a7ce service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:11 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a97f43f4-ed3d-4f53-baf1-7cdc624ead12 req-98f77ff5-6593-4088-a1b5-e4ab2de8a7ce service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:11 user nova-compute[75826]: DEBUG nova.compute.manager [req-a97f43f4-ed3d-4f53-baf1-7cdc624ead12 req-98f77ff5-6593-4088-a1b5-e4ab2de8a7ce service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] No waiting events found dispatching network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:04:11 user nova-compute[75826]: WARNING nova.compute.manager [req-a97f43f4-ed3d-4f53-baf1-7cdc624ead12 req-98f77ff5-6593-4088-a1b5-e4ab2de8a7ce service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received unexpected event network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 for instance with vm_state building and task_state spawning.
Nov 16 01:04:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 01:04:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 01:04:13 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Instance spawned successfully.
Nov 16 01:04:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 01:04:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:04:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:04:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:04:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:04:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:04:13 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:04:13 user nova-compute[75826]: INFO nova.compute.manager [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Took 4.81 seconds to spawn the instance on the hypervisor.
Nov 16 01:04:13 user nova-compute[75826]: DEBUG nova.compute.manager [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:04:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-ab3404ea-b823-4fac-abc4-e681a3fffeaf req-64fa38fc-f86b-46b7-b5f4-802cd220ca60 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab3404ea-b823-4fac-abc4-e681a3fffeaf req-64fa38fc-f86b-46b7-b5f4-802cd220ca60 service nova] Acquiring lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab3404ea-b823-4fac-abc4-e681a3fffeaf req-64fa38fc-f86b-46b7-b5f4-802cd220ca60 service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ab3404ea-b823-4fac-abc4-e681a3fffeaf req-64fa38fc-f86b-46b7-b5f4-802cd220ca60 service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:13 user nova-compute[75826]: DEBUG nova.compute.manager [req-ab3404ea-b823-4fac-abc4-e681a3fffeaf req-64fa38fc-f86b-46b7-b5f4-802cd220ca60 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] No waiting events found dispatching network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:04:13 user nova-compute[75826]: WARNING nova.compute.manager [req-ab3404ea-b823-4fac-abc4-e681a3fffeaf req-64fa38fc-f86b-46b7-b5f4-802cd220ca60 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received unexpected event network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 for instance with vm_state building and task_state spawning.
Nov 16 01:04:13 user nova-compute[75826]: INFO nova.compute.manager [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Took 10.36 seconds to build instance.
Nov 16 01:04:13 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02d9eba8-7dc2-44f2-b2bf-c6b173c23d66 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.447s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:15 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:04:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:16 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:04:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:04:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:04:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:04:16 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:04:16 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updating instance_info_cache with network_info: [{"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:04:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:04:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:04:18 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:04:19 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:04:20 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:04:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:22 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:04:22 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:04:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=8260MB free_disk=25.05560302734375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:04:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 574817b0-a25c-4da1-9ce6-804008e8279c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:04:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:04:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 8705a8fc-b910-45b0-9d54-12b525954bee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:04:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:04:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance e39ea0c5-98bb-4a7f-acca-2812445d0d46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:04:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:04:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:04:22 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:04:22 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:04:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:04:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.287s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:04:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:04:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:04:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:04:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:26 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:04:27 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:04:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:04:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:04:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'flavor' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:35 user nova-compute[75826]: INFO nova.compute.manager [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Attaching volume a1f76738-30a6-4fee-9161-01dfcfbbba15 to /dev/vdb
Nov 16 01:04:35 user nova-compute[75826]: DEBUG os_brick.utils [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cff68e-e1aa-4450-94b8-655e4a8aaa03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:35 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3926b9-e627-4155-9a8f-8157c0e5ec6c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[53543496-0c29-429d-9cf2-cde19b964ecf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e52aab2-0d6d-40c3-bdbd-8d501768652c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:04:36 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d75568-91a7-4b66-a533-aa5624d472a1]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG os_brick.utils [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Updating existing volume attachment record: 7bf644b5-4d31-4a3f-a39f-6f654327ad1a {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG nova.objects.instance [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'flavor' on Instance uuid 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:36 user nova-compute[75826]: INFO nova.compute.manager [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Attaching volume c56f3112-3af8-4fbf-a26d-e2024de45117 to /dev/vdb
Nov 16 01:04:36 user nova-compute[75826]: DEBUG os_brick.utils [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a025ba9-da10-4d8f-b04c-d5c3d05367dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ff5ef5-3a61-4040-b3a8-1f5f39b9f652]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07147cc-0af1-4e0e-8e91-1135fbc2297f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c82ddb-d9ed-4099-a2fe-3a5473ed2c62]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:04:36 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 01:04:36 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[98039ad9-85ff-4870-a8bd-d5d73cd35fa2]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG os_brick.utils [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:04:36 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updating existing volume attachment record: ac34552b-b06f-4229-b553-a521761bf488 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BxDjsNrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:04:40 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:04:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:04:40 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:04:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:04:40 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e74eef-b01c-4830-8ff1-9386b31bfd6d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 01:04:40 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2429433a-ab45-4efd-86ce-196e5f61f53d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15] added
Nov 16 01:04:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b07bf2b-05f6-4219-8673-8980f475c200]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a893220-ae1e-48ed-9d31-6b32c3784cae]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BxDjsNrp {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BxDjsNrp" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f42c75f-0d24-472f-9f9d-425257092206]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BxDjsNrp'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca08ed9-be7c-406f-9c61-f95f09cddd2d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0228a16a-8ec4-40c1-83fc-3aaed020e8a7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:40 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:04:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:40 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:04:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:04:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5453d98f-7624-4728-8eb7-194e4c283902]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15, portal: 172.16.0.220,3260]
Nov 16 01:04:41 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15, portal: 172.16.0.220,3260] successful.
Nov 16 01:04:41 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d06d71-8510-4575-8380-205bafbf4156]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d6a649-b6c5-4b76-9a33-a0a4d94ce95c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:41 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:04:41 user nova-compute[75826]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 (non-flash)
Nov 16 01:04:41 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:41 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:04:41 user nova-compute[75826]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 (non-flash)
Nov 16 01:04:41 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a69fd9-317a-4892-bde4-8fafb11e53cf]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:04:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BxDjsNrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:04:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:04:42 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23730383036383265', 'path': '/dev/sdd'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:04:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730383036383265', 'path': '/dev/sdd'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:04:42 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'flavor' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:04:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 01:04:42 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:04:42 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 01:04:42 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:04:42 user nova-compute[75826]:   <serial>a1f76738-30a6-4fee-9161-01dfcfbbba15</serial>
Nov 16 01:04:42 user nova-compute[75826]: </disk>
Nov 16 01:04:42 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 01:04:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:04:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:04:42 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No VIF found with MAC fa:16:3e:a4:09:88, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:04:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c0dc70b1-6078-4ce5-8871-e31ff6f81517 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.981s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mshBJQAn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:04:43 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:04:43 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:04:43 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a9aacb-8ce3-4584-b05f-ad6235f269ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 01:04:43 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85832fb-bf9c-4611-8377-f084ea9b1dc8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117] added
Nov 16 01:04:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[234cf2df-ffed-49d1-90ea-7de76cea085f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[44101946-c58a-4deb-9eda-6fbeed6d885c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mshBJQAn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mshBJQAn" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d21080d-5d3c-4f36-aaad-dd965393cb90]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mshBJQAn'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[64cfc473-7f27-43aa-a8c2-05bc8ffce0f4]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a04340-7e09-4f6b-aa2a-07c82de69a77]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:43 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:04:43 user nova-compute[75826]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 (non-flash)
Nov 16 01:04:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:43 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:04:43 user nova-compute[75826]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 (non-flash)
Nov 16 01:04:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a09212-6a66-41fd-b81d-26c09d87f844]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117, portal: 172.16.0.220,3260]
Nov 16 01:04:43 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117, portal: 172.16.0.220,3260] successful.
Nov 16 01:04:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcf0752-abb3-4351-8f9e-7d489ccc8876]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d934bf6-cc8e-4b62-873f-8a990043ffa2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:43 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:04:43 user nova-compute[75826]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 (non-flash)
Nov 16 01:04:43 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:04:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:04:43 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:04:43 user nova-compute[75826]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 (non-flash)
Nov 16 01:04:43 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:04:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1115c80f-a9ff-4334-9c9a-f0ca74b854ea]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:04:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:04:44 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:04:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mshBJQAn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:04:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:04:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23562633030663030', 'path': '/dev/sde'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:04:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562633030663030', 'path': '/dev/sde'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:04:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:44 user nova-compute[75826]: DEBUG nova.objects.instance [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'flavor' on Instance uuid 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:04:44 user nova-compute[75826]: INFO nova.compute.manager [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Detaching volume a1f76738-30a6-4fee-9161-01dfcfbbba15
Nov 16 01:04:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 01:04:44 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:04:44 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 01:04:44 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:04:44 user nova-compute[75826]:   <serial>c56f3112-3af8-4fbf-a26d-e2024de45117</serial>
Nov 16 01:04:44 user nova-compute[75826]: </disk>
Nov 16 01:04:44 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 01:04:44 user nova-compute[75826]: INFO nova.virt.block_device [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Attempting to driver detach volume a1f76738-30a6-4fee-9161-01dfcfbbba15 from mountpoint /dev/vdb
Nov 16 01:04:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Attempting to detach device vdb from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 01:04:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:04:44 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:04:44 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 01:04:44 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:04:44 user nova-compute[75826]:   <serial>a1f76738-30a6-4fee-9161-01dfcfbbba15</serial>
Nov 16 01:04:44 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:04:44 user nova-compute[75826]: </disk>
Nov 16 01:04:44 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:04:44 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Successfully detached device vdb from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the persistent domain config.
Nov 16 01:04:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 01:04:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:04:44 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:04:44 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 01:04:44 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:04:44 user nova-compute[75826]:   <serial>a1f76738-30a6-4fee-9161-01dfcfbbba15</serial>
Nov 16 01:04:44 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:04:44 user nova-compute[75826]: </disk>
Nov 16 01:04:44 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:04:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:04:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:04:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] No VIF found with MAC fa:16:3e:8d:8a:2b, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:04:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-225343c2-0c34-448f-8915-18705ff025cf tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.025s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 01:04:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-8713514a-aa73-4886-8786-5f710d3e3b8e req-8ac76ef3-4b62-45d8-b304-622f994f9672 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-changed-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:47 user nova-compute[75826]: DEBUG nova.compute.manager [req-8713514a-aa73-4886-8786-5f710d3e3b8e req-8ac76ef3-4b62-45d8-b304-622f994f9672 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Refreshing instance network info cache due to event network-changed-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:04:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8713514a-aa73-4886-8786-5f710d3e3b8e req-8ac76ef3-4b62-45d8-b304-622f994f9672 service nova] Acquiring lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:04:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8713514a-aa73-4886-8786-5f710d3e3b8e req-8ac76ef3-4b62-45d8-b304-622f994f9672 service nova] Acquired lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:04:47 user nova-compute[75826]: DEBUG nova.network.neutron [req-8713514a-aa73-4886-8786-5f710d3e3b8e req-8ac76ef3-4b62-45d8-b304-622f994f9672 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Refreshing network info cache for port 974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:04:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-8713514a-aa73-4886-8786-5f710d3e3b8e req-8ac76ef3-4b62-45d8-b304-622f994f9672 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updated VIF entry in instance network info cache for port 974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:04:48 user nova-compute[75826]: DEBUG nova.network.neutron [req-8713514a-aa73-4886-8786-5f710d3e3b8e req-8ac76ef3-4b62-45d8-b304-622f994f9672 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updating instance_info_cache with network_info: [{"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:04:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8713514a-aa73-4886-8786-5f710d3e3b8e req-8ac76ef3-4b62-45d8-b304-622f994f9672 service nova] Releasing lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:04:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "574817b0-a25c-4da1-9ce6-804008e8279c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:49 user nova-compute[75826]: INFO nova.compute.manager [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Terminating instance
Nov 16 01:04:49 user nova-compute[75826]: DEBUG nova.compute.manager [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:04:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-d531bbfb-3ef2-4cc3-a38a-9c039abf0bf5 req-44e788fe-2029-4ac8-bda0-ca83b6fa2a52 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-unplugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d531bbfb-3ef2-4cc3-a38a-9c039abf0bf5 req-44e788fe-2029-4ac8-bda0-ca83b6fa2a52 service nova] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d531bbfb-3ef2-4cc3-a38a-9c039abf0bf5 req-44e788fe-2029-4ac8-bda0-ca83b6fa2a52 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-d531bbfb-3ef2-4cc3-a38a-9c039abf0bf5 req-44e788fe-2029-4ac8-bda0-ca83b6fa2a52 service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-d531bbfb-3ef2-4cc3-a38a-9c039abf0bf5 req-44e788fe-2029-4ac8-bda0-ca83b6fa2a52 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] No waiting events found dispatching network-vif-unplugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-d531bbfb-3ef2-4cc3-a38a-9c039abf0bf5 req-44e788fe-2029-4ac8-bda0-ca83b6fa2a52 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-unplugged-c7936822-0ba8-4241-9e2b-1977e21eba80 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:50 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Instance destroyed successfully.
Nov 16 01:04:50 user nova-compute[75826]: DEBUG nova.objects.instance [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lazy-loading 'resources' on Instance uuid 574817b0-a25c-4da1-9ce6-804008e8279c {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:47:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-590900198',display_name='tempest-ServerRescueNegativeTestJSON-server-590900198',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-590900198',id=25,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T00:52:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c7dc71f0e2f439f9944bd7410db7e08',ramdisk_id='',reservation_id='r-0dmt5wwa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-2102246851',owner_user_name='tempest-ServerRescueNegativeTestJSON-2102246851-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T00:54:37Z,user_data=None,user_id='923da525ba264ea4bf770e3a66319655',uuid=574817b0-a25c-4da1-9ce6-804008e8279c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converting VIF {"id": "c7936822-0ba8-4241-9e2b-1977e21eba80", "address": "fa:16:3e:03:09:38", "network": {"id": "2b523039-da52-4b04-a89b-098c1e795122", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1145143385-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c7dc71f0e2f439f9944bd7410db7e08", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7936822-0b", "ovs_interfaceid": "c7936822-0ba8-4241-9e2b-1977e21eba80", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:09:38,bridge_name='br-int',has_traffic_filtering=True,id=c7936822-0ba8-4241-9e2b-1977e21eba80,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7936822-0b') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG os_vif [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:09:38,bridge_name='br-int',has_traffic_filtering=True,id=c7936822-0ba8-4241-9e2b-1977e21eba80,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7936822-0b') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7936822-0b, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6ece6b8d-6600-466a-8bd6-a09990e68df7) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:50 user nova-compute[75826]: INFO os_vif [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:09:38,bridge_name='br-int',has_traffic_filtering=True,id=c7936822-0ba8-4241-9e2b-1977e21eba80,network=Network(2b523039-da52-4b04-a89b-098c1e795122),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7936822-0b')
Nov 16 01:04:50 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Deleting instance files /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c_del
Nov 16 01:04:50 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Deletion of /opt/stack/data/nova/instances/574817b0-a25c-4da1-9ce6-804008e8279c_del complete
Nov 16 01:04:50 user nova-compute[75826]: INFO nova.compute.manager [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 01:04:50 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:04:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:51 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:04:51 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Took 0.87 seconds to deallocate network for instance.
Nov 16 01:04:51 user nova-compute[75826]: DEBUG nova.compute.manager [req-c8336ecc-24d3-4834-87f1-3485f1715561 req-557c66e3-6fa2-4515-aaad-7d7db0cfc811 service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-deleted-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:51 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:04:51 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:04:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:51 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Deleted allocations for instance 574817b0-a25c-4da1-9ce6-804008e8279c
Nov 16 01:04:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-de8f3e79-7656-48a6-95fa-452fd117d4b4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-de8f3e79-7656-48a6-95fa-452fd117d4b4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:51 user nova-compute[75826]: INFO nova.compute.manager [None req-de8f3e79-7656-48a6-95fa-452fd117d4b4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Rebooting instance
Nov 16 01:04:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-73889143-7a2d-4c6e-87f9-ac0810761608 tempest-ServerRescueNegativeTestJSON-2102246851 tempest-ServerRescueNegativeTestJSON-2102246851-project-member] Lock "574817b0-a25c-4da1-9ce6-804008e8279c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.164s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-de8f3e79-7656-48a6-95fa-452fd117d4b4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:04:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-de8f3e79-7656-48a6-95fa-452fd117d4b4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquired lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:04:51 user nova-compute[75826]: DEBUG nova.network.neutron [None req-de8f3e79-7656-48a6-95fa-452fd117d4b4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:04:52 user nova-compute[75826]: DEBUG nova.compute.manager [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] Acquiring lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] Lock "574817b0-a25c-4da1-9ce6-804008e8279c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:52 user nova-compute[75826]: DEBUG nova.compute.manager [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] No waiting events found dispatching network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:04:52 user nova-compute[75826]: WARNING nova.compute.manager [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] [instance: 574817b0-a25c-4da1-9ce6-804008e8279c] Received unexpected event network-vif-plugged-c7936822-0ba8-4241-9e2b-1977e21eba80 for instance with vm_state deleted and task_state None.
Nov 16 01:04:52 user nova-compute[75826]: DEBUG nova.compute.manager [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-changed-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:52 user nova-compute[75826]: DEBUG nova.compute.manager [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Refreshing instance network info cache due to event network-changed-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:04:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] Acquiring lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:04:52 user nova-compute[75826]: DEBUG nova.network.neutron [None req-de8f3e79-7656-48a6-95fa-452fd117d4b4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updating instance_info_cache with network_info: [{"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:04:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-de8f3e79-7656-48a6-95fa-452fd117d4b4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Releasing lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:04:52 user nova-compute[75826]: DEBUG nova.compute.manager [None req-de8f3e79-7656-48a6-95fa-452fd117d4b4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:04:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] Acquired lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:04:52 user nova-compute[75826]: DEBUG nova.network.neutron [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Refreshing network info cache for port 974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:04:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updated VIF entry in instance network info cache for port 974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:04:53 user nova-compute[75826]: DEBUG nova.network.neutron [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updating instance_info_cache with network_info: [{"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:04:53 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4d7b2e26-97a0-4138-b873-e5a6881af254 req-f0ddd1d7-f9db-4924-9253-3fc13e979b8b service nova] Releasing lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:04:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-9427fc3c-fbfb-431d-b669-c16bd9bf382c req-70d5359b-7da7-4ba8-ae77-8c08085e22ef service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-unplugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9427fc3c-fbfb-431d-b669-c16bd9bf382c req-70d5359b-7da7-4ba8-ae77-8c08085e22ef service nova] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9427fc3c-fbfb-431d-b669-c16bd9bf382c req-70d5359b-7da7-4ba8-ae77-8c08085e22ef service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9427fc3c-fbfb-431d-b669-c16bd9bf382c req-70d5359b-7da7-4ba8-ae77-8c08085e22ef service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:54 user nova-compute[75826]: DEBUG nova.compute.manager [req-9427fc3c-fbfb-431d-b669-c16bd9bf382c req-70d5359b-7da7-4ba8-ae77-8c08085e22ef service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] No waiting events found dispatching network-vif-unplugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:04:54 user nova-compute[75826]: WARNING nova.compute.manager [req-9427fc3c-fbfb-431d-b669-c16bd9bf382c req-70d5359b-7da7-4ba8-ae77-8c08085e22ef service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received unexpected event network-vif-unplugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b for instance with vm_state active and task_state reboot_started.
Nov 16 01:04:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:55 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-de8f3e79-7656-48a6-95fa-452fd117d4b4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Instance shutdown successfully.
Nov 16 01:04:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] No waiting events found dispatching network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:04:57 user nova-compute[75826]: WARNING nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received unexpected event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b for instance with vm_state active and task_state reboot_started.
Nov 16 01:04:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] No waiting events found dispatching network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:04:57 user nova-compute[75826]: WARNING nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received unexpected event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b for instance with vm_state active and task_state reboot_started.
Nov 16 01:04:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] No waiting events found dispatching network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:04:57 user nova-compute[75826]: WARNING nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received unexpected event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b for instance with vm_state active and task_state reboot_started.
Nov 16 01:04:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-unplugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] No waiting events found dispatching network-vif-unplugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:04:57 user nova-compute[75826]: WARNING nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received unexpected event network-vif-unplugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b for instance with vm_state active and task_state reboot_started.
Nov 16 01:04:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] No waiting events found dispatching network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:04:57 user nova-compute[75826]: WARNING nova.compute.manager [req-66b019bb-5769-4b09-be72-e5bb38324707 req-3d9f8573-5367-4af0-98e7-e14c4a2a6747 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received unexpected event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b for instance with vm_state active and task_state reboot_started.
Nov 16 01:04:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:04:59 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Instance running successfully.
Nov 16 01:04:59 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-de8f3e79-7656-48a6-95fa-452fd117d4b4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Instance soft rebooted successfully.
Nov 16 01:04:59 user nova-compute[75826]: DEBUG nova.compute.manager [None req-de8f3e79-7656-48a6-95fa-452fd117d4b4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:04:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-35ad4b6c-5e6d-41df-bc6d-9c7379457b2f req-8f4dfcd0-0226-4f80-9b15-354e86b217fd service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-35ad4b6c-5e6d-41df-bc6d-9c7379457b2f req-8f4dfcd0-0226-4f80-9b15-354e86b217fd service nova] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-35ad4b6c-5e6d-41df-bc6d-9c7379457b2f req-8f4dfcd0-0226-4f80-9b15-354e86b217fd service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-35ad4b6c-5e6d-41df-bc6d-9c7379457b2f req-8f4dfcd0-0226-4f80-9b15-354e86b217fd service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-35ad4b6c-5e6d-41df-bc6d-9c7379457b2f req-8f4dfcd0-0226-4f80-9b15-354e86b217fd service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] No waiting events found dispatching network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:04:59 user nova-compute[75826]: WARNING nova.compute.manager [req-35ad4b6c-5e6d-41df-bc6d-9c7379457b2f req-8f4dfcd0-0226-4f80-9b15-354e86b217fd service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received unexpected event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b for instance with vm_state active and task_state reboot_started.
Nov 16 01:04:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-35ad4b6c-5e6d-41df-bc6d-9c7379457b2f req-8f4dfcd0-0226-4f80-9b15-354e86b217fd service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:04:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-35ad4b6c-5e6d-41df-bc6d-9c7379457b2f req-8f4dfcd0-0226-4f80-9b15-354e86b217fd service nova] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:04:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-35ad4b6c-5e6d-41df-bc6d-9c7379457b2f req-8f4dfcd0-0226-4f80-9b15-354e86b217fd service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:04:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-35ad4b6c-5e6d-41df-bc6d-9c7379457b2f req-8f4dfcd0-0226-4f80-9b15-354e86b217fd service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:04:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-35ad4b6c-5e6d-41df-bc6d-9c7379457b2f req-8f4dfcd0-0226-4f80-9b15-354e86b217fd service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] No waiting events found dispatching network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:04:59 user nova-compute[75826]: WARNING nova.compute.manager [req-35ad4b6c-5e6d-41df-bc6d-9c7379457b2f req-8f4dfcd0-0226-4f80-9b15-354e86b217fd service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received unexpected event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b for instance with vm_state active and task_state reboot_started.
Nov 16 01:04:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-de8f3e79-7656-48a6-95fa-452fd117d4b4 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.270s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:05:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:05 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8705a8fc-b910-45b0-9d54-12b525954bee is timed out.
Nov 16 01:05:05 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Successfully detached device vdb from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the live domain config.
Nov 16 01:05:05 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BxDjsNrp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:05:05 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[71781fb0-fd1d-4f60-b745-bec641ced8a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:05:05 user nova-compute[75826]: No targets found.
Nov 16 01:05:05 user nova-compute[75826]: iSNS:
Nov 16 01:05:05 user nova-compute[75826]: No targets found.
Nov 16 01:05:05 user nova-compute[75826]: STATIC:
Nov 16 01:05:05 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6
Nov 16 01:05:05 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:05:05 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:05:05 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec
Nov 16 01:05:05 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:05:05 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:05:05 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15
Nov 16 01:05:05 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:05:05 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:05:05 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117
Nov 16 01:05:05 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:05:05 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:05:05 user nova-compute[75826]: FIRMWARE:
Nov 16 01:05:05 user nova-compute[75826]: No targets found.
Nov 16 01:05:05 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:05:05 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:05:05 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4742279-72c2-429f-9e03-22271cb751ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ea8de5-b3c5-4e38-aaf4-2cd96fd1ef4e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:05:05 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:05:05 user nova-compute[75826]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 (non-flash)
Nov 16 01:05:05 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:05:05 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:05:05 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:05:05 user nova-compute[75826]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 (non-flash)
Nov 16 01:05:05 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:05:05 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb4239bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15'): ({'sdd'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Removing single pathed devices sdd {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[868676ca-7ea1-462c-a864-3a2eec394470]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[700cbe62-fa88-404e-82a3-d92e6be041a0]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Flushing IO for device /dev/sdd {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec5f0a0-90c7-4d3f-a879-7586a60d0e3f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75824dd-1fa9-4e52-a00a-111f1430dbe7]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2cb3cf0-7819-4c9a-ab58-0ebf60f789d4]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5096da-7387-46ef-9a1a-93112892bb21]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15, portal: 172.16.0.220,3260]
Nov 16 01:05:05 user nova-compute[75826]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15, portal: 172.16.0.220,3260] successful.
Nov 16 01:05:05 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a1f76738-30a6-4fee-9161-01dfcfbbba15 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb6dda8-fc33-4518-8d57-d8aa68c09fc7]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] <== disconnect_volume: return (329ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:05:05 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:05:06 user nova-compute[75826]: DEBUG nova.objects.instance [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'flavor' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:05:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-979a5b22-719c-49fd-8f22-2b77e8398cb2 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.839s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:05:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:05:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:05:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:05:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:05:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:16 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:05:18 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:05:18 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:05:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-8705a8fc-b910-45b0-9d54-12b525954bee" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:05:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-8705a8fc-b910-45b0-9d54-12b525954bee" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:05:18 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:05:18 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Updating instance_info_cache with network_info: [{"id": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "address": "fa:16:3e:a4:09:88", "network": {"id": "ad13eecf-14bf-4dab-85fa-eac1e5a6bc82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-369970053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00e572425d9b49da8def94110f3b583f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b9a96a-36", "ovs_interfaceid": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:05:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-8705a8fc-b910-45b0-9d54-12b525954bee" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:05:18 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:05:19 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:05:20 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:05:20 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:05:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:05:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:05:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.rescue --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:23 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:05:23 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=8407MB free_disk=25.072433471679688GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 8705a8fc-b910-45b0-9d54-12b525954bee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance e39ea0c5-98bb-4a7f-acca-2812445d0d46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing inventories for resource provider 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating ProviderTree inventory for provider 015246d3-5250-41ea-8943-b837ba3f5938 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating inventory in ProviderTree for provider 015246d3-5250-41ea-8943-b837ba3f5938 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing aggregate associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, aggregates: None {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing trait associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75826) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 01:05:23 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:05:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:26 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:05:29 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:05:29 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:05:29 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:05:29 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 01:05:29 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] There are 0 instances to clean {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 01:05:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:05:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:05:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:34 user nova-compute[75826]: INFO nova.compute.manager [None req-4286cfba-3589-47e1-b520-231e634d2506 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Unrescuing
Nov 16 01:05:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4286cfba-3589-47e1-b520-231e634d2506 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:05:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4286cfba-3589-47e1-b520-231e634d2506 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquired lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:05:34 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4286cfba-3589-47e1-b520-231e634d2506 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:05:35 user nova-compute[75826]: DEBUG nova.network.neutron [None req-4286cfba-3589-47e1-b520-231e634d2506 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updating instance_info_cache with network_info: [{"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:05:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-4286cfba-3589-47e1-b520-231e634d2506 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Releasing lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:05:35 user nova-compute[75826]: DEBUG nova.objects.instance [None req-4286cfba-3589-47e1-b520-231e634d2506 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lazy-loading 'flavor' on Instance uuid 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:05:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-7978262e-127e-4ab3-97aa-97e3951c0767 req-396e8165-4c25-4f2c-9254-a114b2a0c699 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-unplugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:05:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7978262e-127e-4ab3-97aa-97e3951c0767 req-396e8165-4c25-4f2c-9254-a114b2a0c699 service nova] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:05:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7978262e-127e-4ab3-97aa-97e3951c0767 req-396e8165-4c25-4f2c-9254-a114b2a0c699 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:05:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-7978262e-127e-4ab3-97aa-97e3951c0767 req-396e8165-4c25-4f2c-9254-a114b2a0c699 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:05:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-7978262e-127e-4ab3-97aa-97e3951c0767 req-396e8165-4c25-4f2c-9254-a114b2a0c699 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] No waiting events found dispatching network-vif-unplugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:05:35 user nova-compute[75826]: WARNING nova.compute.manager [req-7978262e-127e-4ab3-97aa-97e3951c0767 req-396e8165-4c25-4f2c-9254-a114b2a0c699 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received unexpected event network-vif-unplugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d for instance with vm_state rescued and task_state unrescuing.
Nov 16 01:05:35 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Instance destroyed successfully.
Nov 16 01:05:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:37 user nova-compute[75826]: DEBUG nova.compute.manager [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-changed-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:05:37 user nova-compute[75826]: DEBUG nova.compute.manager [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Refreshing instance network info cache due to event network-changed-50cf91b8-33b8-4556-8bee-bb6565d7ef4d. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:05:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Acquiring lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:05:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Acquired lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:05:37 user nova-compute[75826]: DEBUG nova.network.neutron [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Refreshing network info cache for port 50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:05:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.objects.instance [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'flavor' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.network.neutron [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updated VIF entry in instance network info cache for port 50cf91b8-33b8-4556-8bee-bb6565d7ef4d. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.network.neutron [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updating instance_info_cache with network_info: [{"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Releasing lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-changed-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Refreshing instance network info cache due to event network-changed-50cf91b8-33b8-4556-8bee-bb6565d7ef4d. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Acquiring lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Acquired lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.network.neutron [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Refreshing network info cache for port 50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:05:38 user nova-compute[75826]: INFO nova.compute.manager [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Attaching volume 67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 to /dev/vdb
Nov 16 01:05:38 user nova-compute[75826]: DEBUG os_brick.utils [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8759301c-98b4-4754-8654-c735b4421dc0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[02761e41-0ad7-4759-b7d8-209d7b285a6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d066aa3-e566-4bcf-b93c-57c3c5ca4af5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[467436c8-a153-45a3-a8df-bda45120d96f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:05:38 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8265f5a7-6e96-4b1f-9dba-46908b679a81]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG os_brick.utils [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Updating existing volume attachment record: ffe69cd0-b6bb-4c70-82a6-2f341e47321b {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.network.neutron [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updated VIF entry in instance network info cache for port 50cf91b8-33b8-4556-8bee-bb6565d7ef4d. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.network.neutron [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updating instance_info_cache with network_info: [{"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Releasing lock "refresh_cache-0fdae035-f108-4ea2-a70d-aa31a0e8522f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] No waiting events found dispatching network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:05:38 user nova-compute[75826]: WARNING nova.compute.manager [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received unexpected event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d for instance with vm_state rescued and task_state unrescuing.
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] No waiting events found dispatching network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:05:38 user nova-compute[75826]: WARNING nova.compute.manager [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received unexpected event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d for instance with vm_state rescued and task_state unrescuing.
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:05:38 user nova-compute[75826]: DEBUG nova.compute.manager [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] No waiting events found dispatching network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:05:38 user nova-compute[75826]: WARNING nova.compute.manager [req-8bd85f60-b763-4d30-b62f-3abe4ba32bfa req-d50c9a3c-172d-4e54-b3c8-170f38e32cc9 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received unexpected event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d for instance with vm_state rescued and task_state unrescuing.
Nov 16 01:05:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-4286cfba-3589-47e1-b520-231e634d2506 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:05:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdlLrZDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:05:43 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:05:43 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:05:43 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde29af5-5829-4fbf-9c11-c0d05bac32b3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 01:05:43 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50a0fe7-2154-46f5-8bcb-e9ec750baa98]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8] added
Nov 16 01:05:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b09440-f2ed-44be-9c15-5b7bd8f647e1]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5696242-de49-4a43-954c-f3b7f942d8a2]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XdlLrZDA {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XdlLrZDA" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[184f3bdd-ee39-41a1-a5c5-1aef81903c63]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XdlLrZDA'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4f0a37-5dd6-446e-854c-d46fe9ff7253]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fba9890-fac9-41a3-9e40-f0afa76c6adb]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:05:43 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:05:43 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:05:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:05:43 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:05:43 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:05:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af3c9a8-d6cd-45bf-a44f-0a6edcd147e8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8, portal: 172.16.0.220,3260]
Nov 16 01:05:43 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8, portal: 172.16.0.220,3260] successful.
Nov 16 01:05:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe30900b-5c3c-4ddd-80c2-f6b3afef6568]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[106be824-8a51-490b-8df9-8d4ca047eb44]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:05:43 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:05:43 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:05:43 user nova-compute[75826]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 (non-flash)
Nov 16 01:05:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:05:43 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:05:43 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:05:43 user nova-compute[75826]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 (non-flash)
Nov 16 01:05:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6e27d4-6820-4359-8f39-035d67f08176]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:05:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdlLrZDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:05:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:05:44 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23262353237623262', 'path': '/dev/sdd'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:05:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262353237623262', 'path': '/dev/sdd'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:05:44 user nova-compute[75826]: DEBUG nova.objects.instance [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'flavor' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:05:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] attach device xml: <disk type="block" device="disk">
Nov 16 01:05:44 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:05:44 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 01:05:44 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:05:44 user nova-compute[75826]:   <serial>67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8</serial>
Nov 16 01:05:44 user nova-compute[75826]: </disk>
Nov 16 01:05:44 user nova-compute[75826]:  {{(pid=75826) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 16 01:05:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:05:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:05:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] No VIF found with MAC fa:16:3e:a4:09:88, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:05:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-f325f429-ddd7-436e-b4b2-643b0124aeb1 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.012s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:05:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:05:47 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:05:47 user nova-compute[75826]: INFO nova.compute.manager [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Detaching volume 67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8
Nov 16 01:05:47 user nova-compute[75826]: INFO nova.virt.block_device [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Attempting to driver detach volume 67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 from mountpoint /dev/vdb
Nov 16 01:05:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Attempting to detach device vdb from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 01:05:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:05:47 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:05:47 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 01:05:47 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:05:47 user nova-compute[75826]:   <serial>67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8</serial>
Nov 16 01:05:47 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:05:47 user nova-compute[75826]: </disk>
Nov 16 01:05:47 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:05:47 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Successfully detached device vdb from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the persistent domain config.
Nov 16 01:05:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 01:05:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:05:47 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:05:47 user nova-compute[75826]:   <source dev="/dev/sdd"/>
Nov 16 01:05:47 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:05:47 user nova-compute[75826]:   <serial>67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8</serial>
Nov 16 01:05:47 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:05:47 user nova-compute[75826]: </disk>
Nov 16 01:05:47 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:05:47 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 01:05:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:05:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-1fb66cdd-844e-4ba9-91c0-b6ac6767ef78 req-0b2048cf-6a6e-4f60-bf3b-7866b7d74c68 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-changed-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:05:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-1fb66cdd-844e-4ba9-91c0-b6ac6767ef78 req-0b2048cf-6a6e-4f60-bf3b-7866b7d74c68 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Refreshing instance network info cache due to event network-changed-3741ee96-4a17-46ef-91af-83a9fdb711b3. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:05:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1fb66cdd-844e-4ba9-91c0-b6ac6767ef78 req-0b2048cf-6a6e-4f60-bf3b-7866b7d74c68 service nova] Acquiring lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:05:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1fb66cdd-844e-4ba9-91c0-b6ac6767ef78 req-0b2048cf-6a6e-4f60-bf3b-7866b7d74c68 service nova] Acquired lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:05:55 user nova-compute[75826]: DEBUG nova.network.neutron [req-1fb66cdd-844e-4ba9-91c0-b6ac6767ef78 req-0b2048cf-6a6e-4f60-bf3b-7866b7d74c68 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Refreshing network info cache for port 3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:05:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-1fb66cdd-844e-4ba9-91c0-b6ac6767ef78 req-0b2048cf-6a6e-4f60-bf3b-7866b7d74c68 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Updated VIF entry in instance network info cache for port 3741ee96-4a17-46ef-91af-83a9fdb711b3. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:05:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-1fb66cdd-844e-4ba9-91c0-b6ac6767ef78 req-0b2048cf-6a6e-4f60-bf3b-7866b7d74c68 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Updating instance_info_cache with network_info: [{"id": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "address": "fa:16:3e:e6:4b:6e", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3741ee96-4a", "ovs_interfaceid": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:05:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1fb66cdd-844e-4ba9-91c0-b6ac6767ef78 req-0b2048cf-6a6e-4f60-bf3b-7866b7d74c68 service nova] Releasing lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:05:56 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:06:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG nova.compute.manager [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 01:06:04 user nova-compute[75826]: INFO nova.compute.claims [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Claim successful on node user
Nov 16 01:06:04 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG nova.compute.manager [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG nova.compute.manager [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG nova.network.neutron [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 01:06:04 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 01:06:04 user nova-compute[75826]: DEBUG nova.compute.manager [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG nova.policy [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6c17265442bc48f9b6de5367e91096b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef4135693756414fb70826b0f1d9345c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 01:06:04 user nova-compute[75826]: INFO nova.virt.block_device [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Booting with volume e0cbb2ef-5696-44f9-84e0-341d15776ce6 at /dev/vda
Nov 16 01:06:04 user nova-compute[75826]: DEBUG os_brick.utils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d89475d-2e82-4cdc-9fde-987a53e4f7a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e653234-1e48-4455-8777-6d9efc04dd38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e03f0d-4210-4a54-a383-d1fb49e0b238]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fa00ae-0cf4-4de1-b202-24bf9e867217]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:06:04 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 01:06:04 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b56bb4b-abfa-4d52-888b-1df9d36c8a8a]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG os_brick.utils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:06:04 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Updating existing volume attachment record: ef60534b-d9e7-4c07-95d3-f9abf48dce62 {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 01:06:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Successfully created port: e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 01:06:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:05 user nova-compute[75826]: DEBUG nova.network.neutron [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Successfully updated port: e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 01:06:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "refresh_cache-f8d5b1fd-65b2-4c87-abee-e988451f8ab8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:06:05 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquired lock "refresh_cache-f8d5b1fd-65b2-4c87-abee-e988451f8ab8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:06:06 user nova-compute[75826]: DEBUG nova.network.neutron [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:06:06 user nova-compute[75826]: DEBUG nova.network.neutron [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 01:06:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-3dc6adbe-9eb6-49c3-bf8f-7f7f4c3c60d5 req-7dd12cdc-3d92-4b8a-9b17-8edd73918ecf service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Received event network-changed-e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:06:06 user nova-compute[75826]: DEBUG nova.compute.manager [req-3dc6adbe-9eb6-49c3-bf8f-7f7f4c3c60d5 req-7dd12cdc-3d92-4b8a-9b17-8edd73918ecf service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Refreshing instance network info cache due to event network-changed-e2b7c661-0f79-4431-8440-c7ad6f36e91e. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:06:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3dc6adbe-9eb6-49c3-bf8f-7f7f4c3c60d5 req-7dd12cdc-3d92-4b8a-9b17-8edd73918ecf service nova] Acquiring lock "refresh_cache-f8d5b1fd-65b2-4c87-abee-e988451f8ab8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:06:06 user nova-compute[75826]: DEBUG nova.network.neutron [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Updating instance_info_cache with network_info: [{"id": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "address": "fa:16:3e:99:28:c2", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b7c661-0f", "ovs_interfaceid": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:06:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Releasing lock "refresh_cache-f8d5b1fd-65b2-4c87-abee-e988451f8ab8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:06:06 user nova-compute[75826]: DEBUG nova.compute.manager [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Instance network_info: |[{"id": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "address": "fa:16:3e:99:28:c2", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b7c661-0f", "ovs_interfaceid": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 01:06:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3dc6adbe-9eb6-49c3-bf8f-7f7f4c3c60d5 req-7dd12cdc-3d92-4b8a-9b17-8edd73918ecf service nova] Acquired lock "refresh_cache-f8d5b1fd-65b2-4c87-abee-e988451f8ab8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:06:06 user nova-compute[75826]: DEBUG nova.network.neutron [req-3dc6adbe-9eb6-49c3-bf8f-7f7f4c3c60d5 req-7dd12cdc-3d92-4b8a-9b17-8edd73918ecf service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Refreshing network info cache for port e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:06:06 user nova-compute[75826]: DEBUG nova.network.neutron [req-3dc6adbe-9eb6-49c3-bf8f-7f7f4c3c60d5 req-7dd12cdc-3d92-4b8a-9b17-8edd73918ecf service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Updated VIF entry in instance network info cache for port e2b7c661-0f79-4431-8440-c7ad6f36e91e. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:06:06 user nova-compute[75826]: DEBUG nova.network.neutron [req-3dc6adbe-9eb6-49c3-bf8f-7f7f4c3c60d5 req-7dd12cdc-3d92-4b8a-9b17-8edd73918ecf service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Updating instance_info_cache with network_info: [{"id": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "address": "fa:16:3e:99:28:c2", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b7c661-0f", "ovs_interfaceid": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:06:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-3dc6adbe-9eb6-49c3-bf8f-7f7f4c3c60d5 req-7dd12cdc-3d92-4b8a-9b17-8edd73918ecf service nova] Releasing lock "refresh_cache-f8d5b1fd-65b2-4c87-abee-e988451f8ab8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:06:07 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8705a8fc-b910-45b0-9d54-12b525954bee is timed out.
Nov 16 01:06:07 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Successfully detached device vdb from instance 8705a8fc-b910-45b0-9d54-12b525954bee from the live domain config.
Nov 16 01:06:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XdlLrZDA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:06:07 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:06:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[042b60a7-90ff-4f89-bcc5-757b13434ac3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:06:07 user nova-compute[75826]: No targets found.
Nov 16 01:06:07 user nova-compute[75826]: iSNS:
Nov 16 01:06:07 user nova-compute[75826]: No targets found.
Nov 16 01:06:07 user nova-compute[75826]: STATIC:
Nov 16 01:06:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6
Nov 16 01:06:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:06:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:06:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec
Nov 16 01:06:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:06:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:06:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117
Nov 16 01:06:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:06:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:06:07 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8
Nov 16 01:06:07 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:06:07 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:06:07 user nova-compute[75826]: FIRMWARE:
Nov 16 01:06:07 user nova-compute[75826]: No targets found.
Nov 16 01:06:07 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:06:07 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:06:07 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dfb47f-6b12-48c7-8ad6-f393f8b09c1c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[60524b25-5f23-43fd-bee4-e634c00391d2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:06:08 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:06:08 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:06:08 user nova-compute[75826]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 (non-flash)
Nov 16 01:06:08 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:06:08 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:06:08 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:06:08 user nova-compute[75826]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 (non-flash)
Nov 16 01:06:08 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd944f2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8'): ({'sdd'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Removing single pathed devices sdd {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:06:08 user nova-compute[75826]: INFO nova.compute.manager [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Detaching volume 0f744fab-37e6-4927-9403-b124e39f48ec
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e462690c-baa4-4660-9837-124d15e0bc13]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c65696-72e7-4239-9292-748473afd472]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Flushing IO for device /dev/sdd {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:08 user nova-compute[75826]: INFO nova.virt.block_device [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Attempting to driver detach volume 0f744fab-37e6-4927-9403-b124e39f48ec from mountpoint /dev/vdb
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dd09aa-27fb-43af-9acb-333b59cf162b]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Attempting to detach device vdb from instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:06:08 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:06:08 user nova-compute[75826]:   <source dev="/dev/sdc"/>
Nov 16 01:06:08 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:06:08 user nova-compute[75826]:   <serial>0f744fab-37e6-4927-9403-b124e39f48ec</serial>
Nov 16 01:06:08 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:06:08 user nova-compute[75826]: </disk>
Nov 16 01:06:08 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:06:08 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Successfully detached device vdb from instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f from the persistent domain config.
Nov 16 01:06:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:06:08 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:06:08 user nova-compute[75826]:   <source dev="/dev/sdc"/>
Nov 16 01:06:08 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:06:08 user nova-compute[75826]:   <serial>0f744fab-37e6-4927-9403-b124e39f48ec</serial>
Nov 16 01:06:08 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:06:08 user nova-compute[75826]: </disk>
Nov 16 01:06:08 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa337a88-988b-4962-8302-e0d73b44c01a]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5242561-c5c0-4264-bd4b-0d64ef6a1bf5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9ca989-d3d9-4e45-a762-7278316b33c6]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8, portal: 172.16.0.220,3260]
Nov 16 01:06:08 user nova-compute[75826]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8, portal: 172.16.0.220,3260] successful.
Nov 16 01:06:08 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a7aa40-e0b8-4a26-b3f6-8ced4ada8fe8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13769b1-17f1-493d-8c93-b7041a0b5dbd]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] <== disconnect_volume: return (329ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 01:06:08 user nova-compute[75826]: DEBUG nova.objects.instance [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'flavor' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-157fae24-4031-44e4-a192-e80565722f6e tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.708s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.compute.manager [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 01:06:09 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Creating image(s)
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Ensure instance console log exists: /opt/stack/data/nova/instances/f8d5b1fd-65b2-4c87-abee-e988451f8ab8/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Start _get_guest_xml network_info=[{"id": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "address": "fa:16:3e:99:28:c2", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b7c661-0f", "ovs_interfaceid": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'ef60534b-d9e7-4c07-95d3-f9abf48dce62', 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnbmcpVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f8d5b1fd-65b2-4c87-abee-e988451f8ab8', 'attached_at': '', 'detached_at': '', 'volume_id': 'e0cbb2ef-5696-44f9-84e0-341d15776ce6', 'serial': 'e0cbb2ef-5696-44f9-84e0-341d15776ce6'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 01:06:09 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:06:09 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnbmcpVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:06:09 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:06:09 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:06:09 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[787b3870-4a2f-4f77-bc99-814b909af61e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 01:06:09 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a5159f-2cb0-4418-84aa-058c5dd35a24]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6] added
Nov 16 01:06:09 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9e3836-3139-49d7-bb34-6bc554f4add9]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bdc984-627b-426d-adb8-56d67174dca2]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lnbmcpVO {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lnbmcpVO" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fff628-3dc4-4b3a-ab24-d876a0ba1453]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lnbmcpVO'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7673d404-557c-4c95-b125-641bf9423f5a]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae295af-ba9f-4fe3-bec3-1e32109a5b07]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:06:09 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:06:09 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:06:09 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:06:09 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:06:09 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:06:09 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea064199-76c2-4c68-a238-426c925c5461]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6, portal: 172.16.0.220,3260]
Nov 16 01:06:09 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6, portal: 172.16.0.220,3260] successful.
Nov 16 01:06:09 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:09 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[71244bf0-40b5-4fde-a263-447b51309eac]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2365fa-f1aa-4133-8e32-a0327a09b7e1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:06:10 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:06:10 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:06:10 user nova-compute[75826]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 (non-flash)
Nov 16 01:06:10 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:06:10 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:06:10 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:06:10 user nova-compute[75826]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 (non-flash)
Nov 16 01:06:10 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c16e1376-3aae-4c6c-b1ef-371ad52f9d06]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnbmcpVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '26333396536373232', 'path': '/dev/sdd'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333396536373232', 'path': '/dev/sdd'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-397398097',display_name='tempest-TestVolumeBootPattern-server-397398097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-397398097',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm3ahxdyhMyQRGdodmVB4rNyVTsBs9l2wJPImRwyG338XqNyzGOLQ50rip2YKesURLjC0iv5HRzeJcmp1NyHE7ZZ5taylxF05FJcu5bUEFb8Cv7u/1iu868o42QyRdnsQ==',key_name='tempest-TestVolumeBootPattern-1182608151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-3r8b54c2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:06:05Z,user_data=None,user_id='6c17265442bc48f9b6de5367e91096b2',uuid=f8d5b1fd-65b2-4c87-abee-e988451f8ab8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "address": "fa:16:3e:99:28:c2", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b7c661-0f", "ovs_interfaceid": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "address": "fa:16:3e:99:28:c2", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b7c661-0f", "ovs_interfaceid": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:28:c2,bridge_name='br-int',has_traffic_filtering=True,id=e2b7c661-0f79-4431-8440-c7ad6f36e91e,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b7c661-0f') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG nova.objects.instance [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lazy-loading 'pci_devices' on Instance uuid f8d5b1fd-65b2-4c87-abee-e988451f8ab8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] End _get_guest_xml xml=<domain type="kvm">
Nov 16 01:06:11 user nova-compute[75826]:   <uuid>f8d5b1fd-65b2-4c87-abee-e988451f8ab8</uuid>
Nov 16 01:06:11 user nova-compute[75826]:   <name>instance-00000030</name>
Nov 16 01:06:11 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 01:06:11 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 01:06:11 user nova-compute[75826]:   <metadata>
Nov 16 01:06:11 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 01:06:11 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 01:06:11 user nova-compute[75826]:       <nova:name>tempest-TestVolumeBootPattern-server-397398097</nova:name>
Nov 16 01:06:11 user nova-compute[75826]:       <nova:creationTime>2023-11-16 01:06:09</nova:creationTime>
Nov 16 01:06:11 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 01:06:11 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 01:06:11 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 01:06:11 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 01:06:11 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 01:06:11 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 01:06:11 user nova-compute[75826]:       </nova:flavor>
Nov 16 01:06:11 user nova-compute[75826]:       <nova:owner>
Nov 16 01:06:11 user nova-compute[75826]:         <nova:user uuid="6c17265442bc48f9b6de5367e91096b2">tempest-TestVolumeBootPattern-2108626012-project-member</nova:user>
Nov 16 01:06:11 user nova-compute[75826]:         <nova:project uuid="ef4135693756414fb70826b0f1d9345c">tempest-TestVolumeBootPattern-2108626012</nova:project>
Nov 16 01:06:11 user nova-compute[75826]:       </nova:owner>
Nov 16 01:06:11 user nova-compute[75826]:       <nova:ports>
Nov 16 01:06:11 user nova-compute[75826]:         <nova:port uuid="e2b7c661-0f79-4431-8440-c7ad6f36e91e">
Nov 16 01:06:11 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 16 01:06:11 user nova-compute[75826]:         </nova:port>
Nov 16 01:06:11 user nova-compute[75826]:       </nova:ports>
Nov 16 01:06:11 user nova-compute[75826]:     </nova:instance>
Nov 16 01:06:11 user nova-compute[75826]:   </metadata>
Nov 16 01:06:11 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 01:06:11 user nova-compute[75826]:     <system>
Nov 16 01:06:11 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 01:06:11 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 01:06:11 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 01:06:11 user nova-compute[75826]:       <entry name="serial">f8d5b1fd-65b2-4c87-abee-e988451f8ab8</entry>
Nov 16 01:06:11 user nova-compute[75826]:       <entry name="uuid">f8d5b1fd-65b2-4c87-abee-e988451f8ab8</entry>
Nov 16 01:06:11 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 01:06:11 user nova-compute[75826]:     </system>
Nov 16 01:06:11 user nova-compute[75826]:   </sysinfo>
Nov 16 01:06:11 user nova-compute[75826]:   <os>
Nov 16 01:06:11 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 01:06:11 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 01:06:11 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 01:06:11 user nova-compute[75826]:   </os>
Nov 16 01:06:11 user nova-compute[75826]:   <features>
Nov 16 01:06:11 user nova-compute[75826]:     <acpi/>
Nov 16 01:06:11 user nova-compute[75826]:     <apic/>
Nov 16 01:06:11 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 01:06:11 user nova-compute[75826]:   </features>
Nov 16 01:06:11 user nova-compute[75826]:   <clock offset="utc">
Nov 16 01:06:11 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 01:06:11 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 01:06:11 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 01:06:11 user nova-compute[75826]:   </clock>
Nov 16 01:06:11 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 01:06:11 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 01:06:11 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 01:06:11 user nova-compute[75826]:   </cpu>
Nov 16 01:06:11 user nova-compute[75826]:   <devices>
Nov 16 01:06:11 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 01:06:11 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:06:11 user nova-compute[75826]:       <source dev="/dev/sdd"/>
Nov 16 01:06:11 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 01:06:11 user nova-compute[75826]:       <serial>e0cbb2ef-5696-44f9-84e0-341d15776ce6</serial>
Nov 16 01:06:11 user nova-compute[75826]:     </disk>
Nov 16 01:06:11 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 01:06:11 user nova-compute[75826]:       <mac address="fa:16:3e:99:28:c2"/>
Nov 16 01:06:11 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:06:11 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 01:06:11 user nova-compute[75826]:       <target dev="tape2b7c661-0f"/>
Nov 16 01:06:11 user nova-compute[75826]:     </interface>
Nov 16 01:06:11 user nova-compute[75826]:     <serial type="pty">
Nov 16 01:06:11 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/f8d5b1fd-65b2-4c87-abee-e988451f8ab8/console.log" append="off"/>
Nov 16 01:06:11 user nova-compute[75826]:     </serial>
Nov 16 01:06:11 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 01:06:11 user nova-compute[75826]:     <video>
Nov 16 01:06:11 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:06:11 user nova-compute[75826]:     </video>
Nov 16 01:06:11 user nova-compute[75826]:     <rng model="virtio">
Nov 16 01:06:11 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 01:06:11 user nova-compute[75826]:     </rng>
Nov 16 01:06:11 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 01:06:11 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 01:06:11 user nova-compute[75826]:       <stats period="10"/>
Nov 16 01:06:11 user nova-compute[75826]:     </memballoon>
Nov 16 01:06:11 user nova-compute[75826]:   </devices>
Nov 16 01:06:11 user nova-compute[75826]: </domain>
Nov 16 01:06:11 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-397398097',display_name='tempest-TestVolumeBootPattern-server-397398097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-397398097',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm3ahxdyhMyQRGdodmVB4rNyVTsBs9l2wJPImRwyG338XqNyzGOLQ50rip2YKesURLjC0iv5HRzeJcmp1NyHE7ZZ5taylxF05FJcu5bUEFb8Cv7u/1iu868o42QyRdnsQ==',key_name='tempest-TestVolumeBootPattern-1182608151',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-3r8b54c2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:06:05Z,user_data=None,user_id='6c17265442bc48f9b6de5367e91096b2',uuid=f8d5b1fd-65b2-4c87-abee-e988451f8ab8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "address": "fa:16:3e:99:28:c2", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b7c661-0f", "ovs_interfaceid": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "address": "fa:16:3e:99:28:c2", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b7c661-0f", "ovs_interfaceid": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:99:28:c2,bridge_name='br-int',has_traffic_filtering=True,id=e2b7c661-0f79-4431-8440-c7ad6f36e91e,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b7c661-0f') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG os_vif [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:28:c2,bridge_name='br-int',has_traffic_filtering=True,id=e2b7c661-0f79-4431-8440-c7ad6f36e91e,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b7c661-0f') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cb26ff9-6f3c-54d4-920c-c20efeeb9cbd', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2b7c661-0f, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2b7c661-0f, col_values=(('qos', UUID('497baa12-3fc2-4f17-a200-0b7c81a130be')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2b7c661-0f, col_values=(('external_ids', {'iface-id': 'e2b7c661-0f79-4431-8440-c7ad6f36e91e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:99:28:c2', 'vm-uuid': 'f8d5b1fd-65b2-4c87-abee-e988451f8ab8'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:11 user nova-compute[75826]: INFO os_vif [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:99:28:c2,bridge_name='br-int',has_traffic_filtering=True,id=e2b7c661-0f79-4431-8440-c7ad6f36e91e,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b7c661-0f')
Nov 16 01:06:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:06:11 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] No VIF found with MAC fa:16:3e:99:28:c2, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:06:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-db7bade7-314b-4def-9f9d-9b8a6b2c1a1e req-4906d2b2-4094-4ad8-b3f4-a5884df17d2a service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Received event network-vif-plugged-e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:06:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-db7bade7-314b-4def-9f9d-9b8a6b2c1a1e req-4906d2b2-4094-4ad8-b3f4-a5884df17d2a service nova] Acquiring lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-db7bade7-314b-4def-9f9d-9b8a6b2c1a1e req-4906d2b2-4094-4ad8-b3f4-a5884df17d2a service nova] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:12 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-db7bade7-314b-4def-9f9d-9b8a6b2c1a1e req-4906d2b2-4094-4ad8-b3f4-a5884df17d2a service nova] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:12 user nova-compute[75826]: DEBUG nova.compute.manager [req-db7bade7-314b-4def-9f9d-9b8a6b2c1a1e req-4906d2b2-4094-4ad8-b3f4-a5884df17d2a service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] No waiting events found dispatching network-vif-plugged-e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:06:12 user nova-compute[75826]: WARNING nova.compute.manager [req-db7bade7-314b-4def-9f9d-9b8a6b2c1a1e req-4906d2b2-4094-4ad8-b3f4-a5884df17d2a service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Received unexpected event network-vif-plugged-e2b7c661-0f79-4431-8440-c7ad6f36e91e for instance with vm_state building and task_state spawning.
Nov 16 01:06:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 01:06:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 01:06:14 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Instance spawned successfully.
Nov 16 01:06:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 01:06:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:06:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:06:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:06:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:06:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:06:14 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:06:14 user nova-compute[75826]: INFO nova.compute.manager [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Took 4.90 seconds to spawn the instance on the hypervisor.
Nov 16 01:06:14 user nova-compute[75826]: DEBUG nova.compute.manager [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:06:14 user nova-compute[75826]: INFO nova.compute.manager [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Took 10.56 seconds to build instance.
Nov 16 01:06:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5b36653a-74cd-4901-9c01-513d497feb67 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.665s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-978ece3b-5492-4f1d-849e-507f0aae3108 req-3c977ae6-dc50-48fb-a978-992b1726103b service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Received event network-vif-plugged-e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:06:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-978ece3b-5492-4f1d-849e-507f0aae3108 req-3c977ae6-dc50-48fb-a978-992b1726103b service nova] Acquiring lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-978ece3b-5492-4f1d-849e-507f0aae3108 req-3c977ae6-dc50-48fb-a978-992b1726103b service nova] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:14 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-978ece3b-5492-4f1d-849e-507f0aae3108 req-3c977ae6-dc50-48fb-a978-992b1726103b service nova] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:14 user nova-compute[75826]: DEBUG nova.compute.manager [req-978ece3b-5492-4f1d-849e-507f0aae3108 req-3c977ae6-dc50-48fb-a978-992b1726103b service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] No waiting events found dispatching network-vif-plugged-e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:06:14 user nova-compute[75826]: WARNING nova.compute.manager [req-978ece3b-5492-4f1d-849e-507f0aae3108 req-3c977ae6-dc50-48fb-a978-992b1726103b service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Received unexpected event network-vif-plugged-e2b7c661-0f79-4431-8440-c7ad6f36e91e for instance with vm_state active and task_state None.
Nov 16 01:06:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:16 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:06:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:19 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:06:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:06:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:06:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:06:19 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:06:19 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updating instance_info_cache with network_info: [{"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:06:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:06:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5018 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:21 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:22 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:06:22 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:06:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=8373MB free_disk=25.068740844726562GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 8705a8fc-b910-45b0-9d54-12b525954bee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance e39ea0c5-98bb-4a7f-acca-2812445d0d46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance f8d5b1fd-65b2-4c87-abee-e988451f8ab8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:06:22 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:06:23 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:06:23 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:06:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:06:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.698s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:24 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:06:25 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:06:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:28 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f is timed out.
Nov 16 01:06:28 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Successfully detached device vdb from instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f from the live domain config.
Nov 16 01:06:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vJIbPaZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:06:28 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c1bd785-8686-4aed-9095-42ae21643873]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:06:28 user nova-compute[75826]: No targets found.
Nov 16 01:06:28 user nova-compute[75826]: iSNS:
Nov 16 01:06:28 user nova-compute[75826]: No targets found.
Nov 16 01:06:28 user nova-compute[75826]: STATIC:
Nov 16 01:06:28 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6
Nov 16 01:06:28 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:06:28 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:06:28 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6
Nov 16 01:06:28 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:06:28 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:06:28 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec
Nov 16 01:06:28 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:06:28 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:06:28 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117
Nov 16 01:06:28 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:06:28 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:06:28 user nova-compute[75826]: FIRMWARE:
Nov 16 01:06:28 user nova-compute[75826]: No targets found.
Nov 16 01:06:28 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:06:28 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:06:28 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a12446-35ba-4a04-97fd-e435a5cc6a75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.135s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3f70e0-132a-4027-8b10-a4c1171db970]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:06:28 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:06:28 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:06:28 user nova-compute[75826]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 (non-flash)
Nov 16 01:06:28 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec (non-flash)
Nov 16 01:06:28 user nova-compute[75826]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:06:28 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:06:28 user nova-compute[75826]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 (non-flash)
Nov 16 01:06:28 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdbc0ca710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec'): ({'sdc'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Removing single pathed devices sdc {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[71911d6a-1f43-4bbb-8e14-0bb92b269740]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d8c00e-e423-4951-ba73-6438ceba88e0]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Flushing IO for device /dev/sdc {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be04638-ffcc-488a-b72b-b80763cf9f3b]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e283906-499d-4a9c-9279-65d597af380f]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] SCSI volumes sdc have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ed46c4-ed05-49cb-980b-ff9f2f5a6318]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3dffa7-ae19-4267-b890-23c9729efd3a]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec, portal: 172.16.0.220,3260]
Nov 16 01:06:28 user nova-compute[75826]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec, portal: 172.16.0.220,3260] successful.
Nov 16 01:06:28 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0f744fab-37e6-4927-9403-b124e39f48ec -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9f8df8-891e-48fa-8369-8a90a9245096]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.417s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] <== disconnect_volume: return (419ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:06:28 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:06:29 user nova-compute[75826]: DEBUG nova.objects.instance [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lazy-loading 'flavor' on Instance uuid 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:06:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-6f1fd67a-56e5-46d9-97a4-9636655fcdab tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.697s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:06:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:06:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:06:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid e39ea0c5-98bb-4a7f-acca-2812445d0d46 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Triggering sync for uuid f8d5b1fd-65b2-4c87-abee-e988451f8ab8 {{(pid=75826) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-5c8af7fe-ea30-481f-8cba-8a598dbff29e req-64941240-a469-4bbb-8fd3-ac4841436c65 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-changed-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-5c8af7fe-ea30-481f-8cba-8a598dbff29e req-64941240-a469-4bbb-8fd3-ac4841436c65 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Refreshing instance network info cache due to event network-changed-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5c8af7fe-ea30-481f-8cba-8a598dbff29e req-64941240-a469-4bbb-8fd3-ac4841436c65 service nova] Acquiring lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5c8af7fe-ea30-481f-8cba-8a598dbff29e req-64941240-a469-4bbb-8fd3-ac4841436c65 service nova] Acquired lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-5c8af7fe-ea30-481f-8cba-8a598dbff29e req-64941240-a469-4bbb-8fd3-ac4841436c65 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Refreshing network info cache for port 974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-bd216489-5cc5-4109-a8f1-73d69f82cac4 req-7f2ce26d-5fcc-4a8f-ae3b-bffa248c3e91 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-changed-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-bd216489-5cc5-4109-a8f1-73d69f82cac4 req-7f2ce26d-5fcc-4a8f-ae3b-bffa248c3e91 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Refreshing instance network info cache due to event network-changed-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bd216489-5cc5-4109-a8f1-73d69f82cac4 req-7f2ce26d-5fcc-4a8f-ae3b-bffa248c3e91 service nova] Acquiring lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-5c8af7fe-ea30-481f-8cba-8a598dbff29e req-64941240-a469-4bbb-8fd3-ac4841436c65 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updated VIF entry in instance network info cache for port 974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-5c8af7fe-ea30-481f-8cba-8a598dbff29e req-64941240-a469-4bbb-8fd3-ac4841436c65 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updating instance_info_cache with network_info: [{"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.188", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5c8af7fe-ea30-481f-8cba-8a598dbff29e req-64941240-a469-4bbb-8fd3-ac4841436c65 service nova] Releasing lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bd216489-5cc5-4109-a8f1-73d69f82cac4 req-7f2ce26d-5fcc-4a8f-ae3b-bffa248c3e91 service nova] Acquired lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:06:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-bd216489-5cc5-4109-a8f1-73d69f82cac4 req-7f2ce26d-5fcc-4a8f-ae3b-bffa248c3e91 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Refreshing network info cache for port 974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:06:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:45 user nova-compute[75826]: DEBUG nova.network.neutron [req-bd216489-5cc5-4109-a8f1-73d69f82cac4 req-7f2ce26d-5fcc-4a8f-ae3b-bffa248c3e91 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updated VIF entry in instance network info cache for port 974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:06:45 user nova-compute[75826]: DEBUG nova.network.neutron [req-bd216489-5cc5-4109-a8f1-73d69f82cac4 req-7f2ce26d-5fcc-4a8f-ae3b-bffa248c3e91 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updating instance_info_cache with network_info: [{"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:06:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bd216489-5cc5-4109-a8f1-73d69f82cac4 req-7f2ce26d-5fcc-4a8f-ae3b-bffa248c3e91 service nova] Releasing lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:06:45 user nova-compute[75826]: INFO nova.compute.manager [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Detaching volume c56f3112-3af8-4fbf-a26d-e2024de45117
Nov 16 01:06:45 user nova-compute[75826]: INFO nova.virt.block_device [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Attempting to driver detach volume c56f3112-3af8-4fbf-a26d-e2024de45117 from mountpoint /dev/vdb
Nov 16 01:06:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Attempting to detach device vdb from instance 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 from the persistent domain config. {{(pid=75826) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 16 01:06:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:06:45 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:06:45 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 01:06:45 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:06:45 user nova-compute[75826]:   <serial>c56f3112-3af8-4fbf-a26d-e2024de45117</serial>
Nov 16 01:06:45 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:06:45 user nova-compute[75826]: </disk>
Nov 16 01:06:45 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:06:45 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Successfully detached device vdb from instance 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 from the persistent domain config.
Nov 16 01:06:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 from the live domain config. {{(pid=75826) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 16 01:06:45 user nova-compute[75826]: DEBUG nova.virt.libvirt.guest [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] detach device xml: <disk type="block" device="disk">
Nov 16 01:06:45 user nova-compute[75826]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:06:45 user nova-compute[75826]:   <source dev="/dev/sde"/>
Nov 16 01:06:45 user nova-compute[75826]:   <target dev="vdb" bus="virtio"/>
Nov 16 01:06:45 user nova-compute[75826]:   <serial>c56f3112-3af8-4fbf-a26d-e2024de45117</serial>
Nov 16 01:06:45 user nova-compute[75826]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 16 01:06:45 user nova-compute[75826]: </disk>
Nov 16 01:06:45 user nova-compute[75826]:  {{(pid=75826) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 16 01:06:46 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 {{(pid=75826) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 16 01:06:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:06:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:06:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:06:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:06:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:58 user nova-compute[75826]: INFO nova.compute.manager [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Terminating instance
Nov 16 01:06:58 user nova-compute[75826]: DEBUG nova.compute.manager [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-ee30578d-0416-4f82-99ef-db923397fbdc req-185e1fef-d7ff-4f4e-ab40-563ff400b20c service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-unplugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ee30578d-0416-4f82-99ef-db923397fbdc req-185e1fef-d7ff-4f4e-ab40-563ff400b20c service nova] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ee30578d-0416-4f82-99ef-db923397fbdc req-185e1fef-d7ff-4f4e-ab40-563ff400b20c service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-ee30578d-0416-4f82-99ef-db923397fbdc req-185e1fef-d7ff-4f4e-ab40-563ff400b20c service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-ee30578d-0416-4f82-99ef-db923397fbdc req-185e1fef-d7ff-4f4e-ab40-563ff400b20c service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] No waiting events found dispatching network-vif-unplugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:06:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-ee30578d-0416-4f82-99ef-db923397fbdc req-185e1fef-d7ff-4f4e-ab40-563ff400b20c service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-unplugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:59 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Instance destroyed successfully.
Nov 16 01:06:59 user nova-compute[75826]: DEBUG nova.objects.instance [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lazy-loading 'resources' on Instance uuid 0fdae035-f108-4ea2-a70d-aa31a0e8522f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T00:59:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2098629411',display_name='tempest-ServerStableDeviceRescueTest-server-2098629411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2098629411',id=42,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJ49rcYlPu3AwbxNJbwyRMkBPACuPDXxnYanYtoYF2FYYgtFksOxLarA127kouUH5sYUE8xCpEXsRT8jFvSPd4lNUBJS0YkQFomGha4ZIFiABnTeNbLU8q0P5A5RSWTCw==',key_name='tempest-keypair-2011727660',keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:03:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6208d85f7b20490d88f6aab71cd1c1a1',ramdisk_id='',reservation_id='r-02brzyic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1527052191',owner_user_name='tempest-ServerStableDeviceRescueTest-1527052191-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:05:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c09974200c464b9e959d85a652545f5c',uuid=0fdae035-f108-4ea2-a70d-aa31a0e8522f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Converting VIF {"id": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "address": "fa:16:3e:5d:2d:d0", "network": {"id": "c361bb6e-88c9-49af-862e-91799c7b1ce4", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-189128539-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6208d85f7b20490d88f6aab71cd1c1a1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50cf91b8-33", "ovs_interfaceid": "50cf91b8-33b8-4556-8bee-bb6565d7ef4d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2d:d0,bridge_name='br-int',has_traffic_filtering=True,id=50cf91b8-33b8-4556-8bee-bb6565d7ef4d,network=Network(c361bb6e-88c9-49af-862e-91799c7b1ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50cf91b8-33') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG os_vif [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2d:d0,bridge_name='br-int',has_traffic_filtering=True,id=50cf91b8-33b8-4556-8bee-bb6565d7ef4d,network=Network(c361bb6e-88c9-49af-862e-91799c7b1ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50cf91b8-33') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50cf91b8-33, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40452326-c433-407d-a995-7c64e46e615d) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:06:59 user nova-compute[75826]: INFO os_vif [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:2d:d0,bridge_name='br-int',has_traffic_filtering=True,id=50cf91b8-33b8-4556-8bee-bb6565d7ef4d,network=Network(c361bb6e-88c9-49af-862e-91799c7b1ce4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50cf91b8-33')
Nov 16 01:06:59 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Deleting instance files /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f_del
Nov 16 01:06:59 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Deletion of /opt/stack/data/nova/instances/0fdae035-f108-4ea2-a70d-aa31a0e8522f_del complete
Nov 16 01:06:59 user nova-compute[75826]: INFO nova.compute.manager [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 16 01:06:59 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:06:59 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:07:00 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Took 0.79 seconds to deallocate network for instance.
Nov 16 01:07:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-ee44e300-d10b-4fe6-84c6-f0a1e6cfc885 req-67ba07f9-4ee8-4c8c-be81-bfa41086eb00 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-deleted-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:00 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Deleted allocations for instance 0fdae035-f108-4ea2-a70d-aa31a0e8522f
Nov 16 01:07:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-e0d0687d-4b84-475d-aee7-9def3d60ee99 tempest-ServerStableDeviceRescueTest-1527052191 tempest-ServerStableDeviceRescueTest-1527052191-project-member] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.057s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:00 user nova-compute[75826]: INFO nova.compute.manager [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Terminating instance
Nov 16 01:07:00 user nova-compute[75826]: DEBUG nova.compute.manager [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-35ebf48a-d680-42d8-99ed-7c35b7d04923 req-c18cf18d-758a-4b5e-94fa-ee8ba1638645 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-35ebf48a-d680-42d8-99ed-7c35b7d04923 req-c18cf18d-758a-4b5e-94fa-ee8ba1638645 service nova] Acquiring lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-35ebf48a-d680-42d8-99ed-7c35b7d04923 req-c18cf18d-758a-4b5e-94fa-ee8ba1638645 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-35ebf48a-d680-42d8-99ed-7c35b7d04923 req-c18cf18d-758a-4b5e-94fa-ee8ba1638645 service nova] Lock "0fdae035-f108-4ea2-a70d-aa31a0e8522f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:00 user nova-compute[75826]: DEBUG nova.compute.manager [req-35ebf48a-d680-42d8-99ed-7c35b7d04923 req-c18cf18d-758a-4b5e-94fa-ee8ba1638645 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] No waiting events found dispatching network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:07:00 user nova-compute[75826]: WARNING nova.compute.manager [req-35ebf48a-d680-42d8-99ed-7c35b7d04923 req-c18cf18d-758a-4b5e-94fa-ee8ba1638645 service nova] [instance: 0fdae035-f108-4ea2-a70d-aa31a0e8522f] Received unexpected event network-vif-plugged-50cf91b8-33b8-4556-8bee-bb6565d7ef4d for instance with vm_state deleted and task_state None.
Nov 16 01:07:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-af406c42-b748-47cf-981b-9552d04ff9f1 req-b22e77de-86e7-4f1f-b46b-7ec851ec5397 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received event network-vif-unplugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-af406c42-b748-47cf-981b-9552d04ff9f1 req-b22e77de-86e7-4f1f-b46b-7ec851ec5397 service nova] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-af406c42-b748-47cf-981b-9552d04ff9f1 req-b22e77de-86e7-4f1f-b46b-7ec851ec5397 service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-af406c42-b748-47cf-981b-9552d04ff9f1 req-b22e77de-86e7-4f1f-b46b-7ec851ec5397 service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-af406c42-b748-47cf-981b-9552d04ff9f1 req-b22e77de-86e7-4f1f-b46b-7ec851ec5397 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] No waiting events found dispatching network-vif-unplugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG nova.compute.manager [req-af406c42-b748-47cf-981b-9552d04ff9f1 req-b22e77de-86e7-4f1f-b46b-7ec851ec5397 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received event network-vif-unplugged-54b9a96a-3659-41b7-a654-9bfab1f475fd for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:01 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Instance destroyed successfully.
Nov 16 01:07:01 user nova-compute[75826]: DEBUG nova.objects.instance [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lazy-loading 'resources' on Instance uuid 8705a8fc-b910-45b0-9d54-12b525954bee {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:00:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1656028919',display_name='tempest-SnapshotDataIntegrityTests-server-1656028919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1656028919',id=44,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLHIUO8Fx4CUnkQ0BfmWuiYe9f7NCktH3kZbNifYYmBFqp4y+wzlFFMbSRS9Ze7YlNtijVbGs2TCM0jryG+/CUBb/NoTYphNCCgD3CAmP5hHQeL5q6Gb2Eyc1p++oMdOYQ==',key_name='tempest-keypair-413667159',keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:00:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='00e572425d9b49da8def94110f3b583f',ramdisk_id='',reservation_id='r-r903x4id',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1117230790',owner_user_name='tempest-SnapshotDataIntegrityTests-1117230790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:00:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5977fd80d89947a485bfff425143e52d',uuid=8705a8fc-b910-45b0-9d54-12b525954bee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "address": "fa:16:3e:a4:09:88", "network": {"id": "ad13eecf-14bf-4dab-85fa-eac1e5a6bc82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-369970053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00e572425d9b49da8def94110f3b583f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b9a96a-36", "ovs_interfaceid": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Converting VIF {"id": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "address": "fa:16:3e:a4:09:88", "network": {"id": "ad13eecf-14bf-4dab-85fa-eac1e5a6bc82", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-369970053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "00e572425d9b49da8def94110f3b583f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54b9a96a-36", "ovs_interfaceid": "54b9a96a-3659-41b7-a654-9bfab1f475fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:09:88,bridge_name='br-int',has_traffic_filtering=True,id=54b9a96a-3659-41b7-a654-9bfab1f475fd,network=Network(ad13eecf-14bf-4dab-85fa-eac1e5a6bc82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b9a96a-36') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG os_vif [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:09:88,bridge_name='br-int',has_traffic_filtering=True,id=54b9a96a-3659-41b7-a654-9bfab1f475fd,network=Network(ad13eecf-14bf-4dab-85fa-eac1e5a6bc82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b9a96a-36') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54b9a96a-36, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9524486b-d183-4374-ac94-6779df81a666) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:01 user nova-compute[75826]: INFO os_vif [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:09:88,bridge_name='br-int',has_traffic_filtering=True,id=54b9a96a-3659-41b7-a654-9bfab1f475fd,network=Network(ad13eecf-14bf-4dab-85fa-eac1e5a6bc82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54b9a96a-36')
Nov 16 01:07:01 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Deleting instance files /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee_del
Nov 16 01:07:01 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Deletion of /opt/stack/data/nova/instances/8705a8fc-b910-45b0-9d54-12b525954bee_del complete
Nov 16 01:07:01 user nova-compute[75826]: INFO nova.compute.manager [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 16 01:07:01 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:07:01 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:07:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:02 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:07:02 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Took 0.85 seconds to deallocate network for instance.
Nov 16 01:07:02 user nova-compute[75826]: DEBUG nova.compute.manager [req-6a152d3e-60aa-4338-8479-f7be0e807fba req-72859f24-fa25-4663-b0c5-e139e122c003 service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received event network-vif-deleted-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:02 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:07:02 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:07:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:02 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Deleted allocations for instance 8705a8fc-b910-45b0-9d54-12b525954bee
Nov 16 01:07:02 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-5e1e3e75-bcc8-4481-8a1c-66bc18eeb323 tempest-SnapshotDataIntegrityTests-1117230790 tempest-SnapshotDataIntegrityTests-1117230790-project-member] Lock "8705a8fc-b910-45b0-9d54-12b525954bee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.135s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received event network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] No waiting events found dispatching network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:07:03 user nova-compute[75826]: WARNING nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received unexpected event network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd for instance with vm_state deleted and task_state None.
Nov 16 01:07:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received event network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] No waiting events found dispatching network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:07:03 user nova-compute[75826]: WARNING nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received unexpected event network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd for instance with vm_state deleted and task_state None.
Nov 16 01:07:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received event network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] No waiting events found dispatching network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:07:03 user nova-compute[75826]: WARNING nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received unexpected event network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd for instance with vm_state deleted and task_state None.
Nov 16 01:07:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received event network-vif-unplugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] No waiting events found dispatching network-vif-unplugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:07:03 user nova-compute[75826]: WARNING nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received unexpected event network-vif-unplugged-54b9a96a-3659-41b7-a654-9bfab1f475fd for instance with vm_state deleted and task_state None.
Nov 16 01:07:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received event network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Acquiring lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] Lock "8705a8fc-b910-45b0-9d54-12b525954bee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:03 user nova-compute[75826]: DEBUG nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] No waiting events found dispatching network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:07:03 user nova-compute[75826]: WARNING nova.compute.manager [req-67f5b329-5b5c-4c6d-b1d9-76ce88c45e33 req-ffddd9e1-f146-4fb2-980c-ac944847a3bc service nova] [instance: 8705a8fc-b910-45b0-9d54-12b525954bee] Received unexpected event network-vif-plugged-54b9a96a-3659-41b7-a654-9bfab1f475fd for instance with vm_state deleted and task_state None.
Nov 16 01:07:06 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 is timed out.
Nov 16 01:07:06 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Successfully detached device vdb from instance 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 from the live domain config.
Nov 16 01:07:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mshBJQAn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:07:06 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dce12d-ab1d-477e-a98e-8cafb75f48d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:07:06 user nova-compute[75826]: No targets found.
Nov 16 01:07:06 user nova-compute[75826]: iSNS:
Nov 16 01:07:06 user nova-compute[75826]: No targets found.
Nov 16 01:07:06 user nova-compute[75826]: STATIC:
Nov 16 01:07:06 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6
Nov 16 01:07:06 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:07:06 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:07:06 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6
Nov 16 01:07:06 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:07:06 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:07:06 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117
Nov 16 01:07:06 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:07:06 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:07:06 user nova-compute[75826]: FIRMWARE:
Nov 16 01:07:06 user nova-compute[75826]: No targets found.
Nov 16 01:07:06 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:07:06 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:07:06 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2cc73a-3322-4cc6-8174-6ea7abb1b7b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9b6807d-eae7-4165-b0e7-dc2cbd519ab6]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:07:06 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:07:06 user nova-compute[75826]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 (non-flash)
Nov 16 01:07:06 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:07:06 user nova-compute[75826]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 (non-flash)
Nov 16 01:07:06 user nova-compute[75826]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 (non-flash)
Nov 16 01:07:06 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb4291120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117'): ({'sde'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Removing single pathed devices sde {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabd6de7-c9ee-472d-809f-6af323d08672]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[333dd91a-b900-428c-ba92-608d58c874ef]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Flushing IO for device /dev/sde {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4b3db3-7d52-47d0-9f11-4284d51fc205]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.033s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2294c9db-ec42-4d0e-afee-9d41fbd97f34]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] SCSI volumes sde have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bd8689-0219-4884-a929-011a8c102e77]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[16061916-d221-45cb-9aac-bde9f790b0e7]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117, portal: 172.16.0.220,3260]
Nov 16 01:07:06 user nova-compute[75826]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117, portal: 172.16.0.220,3260] successful.
Nov 16 01:07:06 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c56f3112-3af8-4fbf-a26d-e2024de45117 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8fb06c-3b8b-480f-b61c-28aefdad077f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] <== disconnect_volume: return (280ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:07:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:07 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'flavor' on Instance uuid 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:07:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c522e031-7060-4726-b45d-e2b25d35c887 tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.608s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:07:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:07:17 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:07:19 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:07:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:07:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:07:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:07:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:07:19 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:07:19 user nova-compute[75826]: DEBUG nova.objects.instance [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lazy-loading 'info_cache' on Instance uuid 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:07:19 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updating instance_info_cache with network_info: [{"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:07:19 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:07:19 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:07:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:07:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:07:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:07:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:07:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:07:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:07:22 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:07:23 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:07:23 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:07:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=8663MB free_disk=25.212352752685547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance e39ea0c5-98bb-4a7f-acca-2812445d0d46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance f8d5b1fd-65b2-4c87-abee-e988451f8ab8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:07:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:07:24 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:07:24 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:07:24 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:07:24 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:07:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:25 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:07:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:27 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:07:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:07:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:07:31 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:07:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:07:35 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:07:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:39 user nova-compute[75826]: INFO nova.compute.manager [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Terminating instance
Nov 16 01:07:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-aa3d031b-26ec-49df-b9bc-dc67b115cac3 req-c3dd38e8-8bf9-4e24-8b28-81ac9b8a60eb service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-unplugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-aa3d031b-26ec-49df-b9bc-dc67b115cac3 req-c3dd38e8-8bf9-4e24-8b28-81ac9b8a60eb service nova] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-aa3d031b-26ec-49df-b9bc-dc67b115cac3 req-c3dd38e8-8bf9-4e24-8b28-81ac9b8a60eb service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-aa3d031b-26ec-49df-b9bc-dc67b115cac3 req-c3dd38e8-8bf9-4e24-8b28-81ac9b8a60eb service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-aa3d031b-26ec-49df-b9bc-dc67b115cac3 req-c3dd38e8-8bf9-4e24-8b28-81ac9b8a60eb service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] No waiting events found dispatching network-vif-unplugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:07:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-aa3d031b-26ec-49df-b9bc-dc67b115cac3 req-c3dd38e8-8bf9-4e24-8b28-81ac9b8a60eb service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-unplugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:07:40 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Instance destroyed successfully.
Nov 16 01:07:40 user nova-compute[75826]: DEBUG nova.objects.instance [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lazy-loading 'resources' on Instance uuid 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:02:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1038158312',display_name='tempest-TestMinimumBasicScenario-server-1038158312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1038158312',id=46,image_ref='270819c2-4f92-42b4-a645-b94b0a23671c',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM2oeMruFrtPEzFiL7816hKTl/j/Tv/58HnQs/PBG2c1SglwBBT12zyojcJA36l167JL3lM9sz4TvtSZmCAMvXIloS/t+R4G+Jixzk2gU16Hcb+bzs/Ae9qRTXO+PRMS1A==',key_name='tempest-TestMinimumBasicScenario-1069809059',keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:02:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9fa5ce9593fc4a4ea55228dd113781f1',ramdisk_id='',reservation_id='r-d8npjbjk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='270819c2-4f92-42b4-a645-b94b0a23671c',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1996581904',owner_user_name='tempest-TestMinimumBasicScenario-1996581904-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:04:59Z,user_data=None,user_id='64aa8a18510d4d56b341f56cf8d5d3dd',uuid=7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converting VIF {"id": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "address": "fa:16:3e:8d:8a:2b", "network": {"id": "19fb4690-53ed-4982-8105-b1b8dfa367f3", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-749766216-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9fa5ce9593fc4a4ea55228dd113781f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap974c93ce-d7", "ovs_interfaceid": "974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:8a:2b,bridge_name='br-int',has_traffic_filtering=True,id=974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap974c93ce-d7') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG os_vif [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:8a:2b,bridge_name='br-int',has_traffic_filtering=True,id=974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap974c93ce-d7') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap974c93ce-d7, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f84c5125-9d5b-4656-a640-d483b55757a6) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:07:40 user nova-compute[75826]: INFO os_vif [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:8a:2b,bridge_name='br-int',has_traffic_filtering=True,id=974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b,network=Network(19fb4690-53ed-4982-8105-b1b8dfa367f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap974c93ce-d7')
Nov 16 01:07:40 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Deleting instance files /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519_del
Nov 16 01:07:40 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Deletion of /opt/stack/data/nova/instances/7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519_del complete
Nov 16 01:07:40 user nova-compute[75826]: INFO nova.compute.manager [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 01:07:40 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:07:40 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Took 0.44 seconds to deallocate network for instance.
Nov 16 01:07:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-a65bb62b-c703-4e25-b7bc-ef8f02a12d0b req-d9b1accd-22f5-46bc-aee2-c076ebeca991 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-deleted-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:40 user nova-compute[75826]: INFO nova.compute.manager [req-a65bb62b-c703-4e25-b7bc-ef8f02a12d0b req-d9b1accd-22f5-46bc-aee2-c076ebeca991 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Neutron deleted interface 974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b; detaching it from the instance and deleting it from the info cache
Nov 16 01:07:40 user nova-compute[75826]: DEBUG nova.network.neutron [req-a65bb62b-c703-4e25-b7bc-ef8f02a12d0b req-d9b1accd-22f5-46bc-aee2-c076ebeca991 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-a65bb62b-c703-4e25-b7bc-ef8f02a12d0b req-d9b1accd-22f5-46bc-aee2-c076ebeca991 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Detach interface failed, port_id=974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b, reason: Instance 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519 could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:07:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.167s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:40 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Deleted allocations for instance 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519
Nov 16 01:07:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-800bdf8b-7cbf-4a2b-b0c7-a5c4ec22d25f tempest-TestMinimumBasicScenario-1996581904 tempest-TestMinimumBasicScenario-1996581904-project-member] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.681s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-03786366-a781-440a-bf83-3225d974d6a0 req-c534b16d-6d37-4ffd-b224-bdc6ade7ee13 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-03786366-a781-440a-bf83-3225d974d6a0 req-c534b16d-6d37-4ffd-b224-bdc6ade7ee13 service nova] Acquiring lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-03786366-a781-440a-bf83-3225d974d6a0 req-c534b16d-6d37-4ffd-b224-bdc6ade7ee13 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-03786366-a781-440a-bf83-3225d974d6a0 req-c534b16d-6d37-4ffd-b224-bdc6ade7ee13 service nova] Lock "7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-03786366-a781-440a-bf83-3225d974d6a0 req-c534b16d-6d37-4ffd-b224-bdc6ade7ee13 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] No waiting events found dispatching network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:07:41 user nova-compute[75826]: WARNING nova.compute.manager [req-03786366-a781-440a-bf83-3225d974d6a0 req-c534b16d-6d37-4ffd-b224-bdc6ade7ee13 service nova] [instance: 7b73a3c1-dbdd-49dc-a7ce-9b4c9d8b6519] Received unexpected event network-vif-plugged-974c93ce-d76e-4f1a-aba8-b9b3c0c25c9b for instance with vm_state deleted and task_state None.
Nov 16 01:07:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:07:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:07:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:07:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:07:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-f3f9515c-26a1-486a-b09b-fca07b56b6bb req-762d90fd-b1d1-4e80-acf9-96ccdd13438a service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Received event network-changed-e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:55 user nova-compute[75826]: DEBUG nova.compute.manager [req-f3f9515c-26a1-486a-b09b-fca07b56b6bb req-762d90fd-b1d1-4e80-acf9-96ccdd13438a service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Refreshing instance network info cache due to event network-changed-e2b7c661-0f79-4431-8440-c7ad6f36e91e. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:07:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f3f9515c-26a1-486a-b09b-fca07b56b6bb req-762d90fd-b1d1-4e80-acf9-96ccdd13438a service nova] Acquiring lock "refresh_cache-f8d5b1fd-65b2-4c87-abee-e988451f8ab8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:07:55 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f3f9515c-26a1-486a-b09b-fca07b56b6bb req-762d90fd-b1d1-4e80-acf9-96ccdd13438a service nova] Acquired lock "refresh_cache-f8d5b1fd-65b2-4c87-abee-e988451f8ab8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:07:55 user nova-compute[75826]: DEBUG nova.network.neutron [req-f3f9515c-26a1-486a-b09b-fca07b56b6bb req-762d90fd-b1d1-4e80-acf9-96ccdd13438a service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Refreshing network info cache for port e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:07:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-f3f9515c-26a1-486a-b09b-fca07b56b6bb req-762d90fd-b1d1-4e80-acf9-96ccdd13438a service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Updated VIF entry in instance network info cache for port e2b7c661-0f79-4431-8440-c7ad6f36e91e. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:07:56 user nova-compute[75826]: DEBUG nova.network.neutron [req-f3f9515c-26a1-486a-b09b-fca07b56b6bb req-762d90fd-b1d1-4e80-acf9-96ccdd13438a service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Updating instance_info_cache with network_info: [{"id": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "address": "fa:16:3e:99:28:c2", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b7c661-0f", "ovs_interfaceid": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:07:56 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f3f9515c-26a1-486a-b09b-fca07b56b6bb req-762d90fd-b1d1-4e80-acf9-96ccdd13438a service nova] Releasing lock "refresh_cache-f8d5b1fd-65b2-4c87-abee-e988451f8ab8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-dbb7fc8e-6b0d-4751-bac4-ac3b7388b7c3 req-a8717298-0198-4143-a81f-d6d8ca425676 service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Received event network-changed-e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-dbb7fc8e-6b0d-4751-bac4-ac3b7388b7c3 req-a8717298-0198-4143-a81f-d6d8ca425676 service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Refreshing instance network info cache due to event network-changed-e2b7c661-0f79-4431-8440-c7ad6f36e91e. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dbb7fc8e-6b0d-4751-bac4-ac3b7388b7c3 req-a8717298-0198-4143-a81f-d6d8ca425676 service nova] Acquiring lock "refresh_cache-f8d5b1fd-65b2-4c87-abee-e988451f8ab8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dbb7fc8e-6b0d-4751-bac4-ac3b7388b7c3 req-a8717298-0198-4143-a81f-d6d8ca425676 service nova] Acquired lock "refresh_cache-f8d5b1fd-65b2-4c87-abee-e988451f8ab8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG nova.network.neutron [req-dbb7fc8e-6b0d-4751-bac4-ac3b7388b7c3 req-a8717298-0198-4143-a81f-d6d8ca425676 service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Refreshing network info cache for port e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:57 user nova-compute[75826]: INFO nova.compute.manager [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Terminating instance
Nov 16 01:07:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG nova.network.neutron [req-dbb7fc8e-6b0d-4751-bac4-ac3b7388b7c3 req-a8717298-0198-4143-a81f-d6d8ca425676 service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Updated VIF entry in instance network info cache for port e2b7c661-0f79-4431-8440-c7ad6f36e91e. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG nova.network.neutron [req-dbb7fc8e-6b0d-4751-bac4-ac3b7388b7c3 req-a8717298-0198-4143-a81f-d6d8ca425676 service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Updating instance_info_cache with network_info: [{"id": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "address": "fa:16:3e:99:28:c2", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b7c661-0f", "ovs_interfaceid": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-dbb7fc8e-6b0d-4751-bac4-ac3b7388b7c3 req-a8717298-0198-4143-a81f-d6d8ca425676 service nova] Releasing lock "refresh_cache-f8d5b1fd-65b2-4c87-abee-e988451f8ab8" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:07:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Instance destroyed successfully.
Nov 16 01:07:57 user nova-compute[75826]: DEBUG nova.objects.instance [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lazy-loading 'resources' on Instance uuid f8d5b1fd-65b2-4c87-abee-e988451f8ab8 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:06:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-397398097',display_name='tempest-TestVolumeBootPattern-server-397398097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-397398097',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm3ahxdyhMyQRGdodmVB4rNyVTsBs9l2wJPImRwyG338XqNyzGOLQ50rip2YKesURLjC0iv5HRzeJcmp1NyHE7ZZ5taylxF05FJcu5bUEFb8Cv7u/1iu868o42QyRdnsQ==',key_name='tempest-TestVolumeBootPattern-1182608151',keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:06:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-3r8b54c2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:06:15Z,user_data=None,user_id='6c17265442bc48f9b6de5367e91096b2',uuid=f8d5b1fd-65b2-4c87-abee-e988451f8ab8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "address": "fa:16:3e:99:28:c2", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b7c661-0f", "ovs_interfaceid": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "address": "fa:16:3e:99:28:c2", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b7c661-0f", "ovs_interfaceid": "e2b7c661-0f79-4431-8440-c7ad6f36e91e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:99:28:c2,bridge_name='br-int',has_traffic_filtering=True,id=e2b7c661-0f79-4431-8440-c7ad6f36e91e,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b7c661-0f') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG os_vif [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:28:c2,bridge_name='br-int',has_traffic_filtering=True,id=e2b7c661-0f79-4431-8440-c7ad6f36e91e,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b7c661-0f') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2b7c661-0f, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=497baa12-3fc2-4f17-a200-0b7c81a130be) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:07:58 user nova-compute[75826]: INFO os_vif [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:99:28:c2,bridge_name='br-int',has_traffic_filtering=True,id=e2b7c661-0f79-4431-8440-c7ad6f36e91e,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b7c661-0f')
Nov 16 01:07:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lnbmcpVO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:07:58 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c222c63-dc91-46c0-a769-f18e2ceae4ac]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:07:58 user nova-compute[75826]: No targets found.
Nov 16 01:07:58 user nova-compute[75826]: iSNS:
Nov 16 01:07:58 user nova-compute[75826]: No targets found.
Nov 16 01:07:58 user nova-compute[75826]: STATIC:
Nov 16 01:07:58 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6
Nov 16 01:07:58 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:07:58 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:07:58 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6
Nov 16 01:07:58 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:07:58 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:07:58 user nova-compute[75826]: FIRMWARE:
Nov 16 01:07:58 user nova-compute[75826]: No targets found.
Nov 16 01:07:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:07:58 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:07:58 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56b3fd2-e0a4-4fad-ab21-feb0e0f6cc19]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[80035653-0455-4989-aa71-3a1dc69d27db]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:07:58 user nova-compute[75826]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 (non-flash)
Nov 16 01:07:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:07:58 user nova-compute[75826]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 (non-flash)
Nov 16 01:07:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd946f1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6'): ({'sdd'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Removing single pathed devices sdd {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be9292e-6b56-4c33-97a0-6844abd9777b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6267a7-aeed-4570-94ed-30894d5b2d11]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flushing IO for device /dev/sdd {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[838d5eb2-1c97-44a8-9a17-0bf6cceeadcc]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[53485230-9947-4247-a213-49e67417fdea]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] SCSI volumes sdd have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_a234eea9', '/dev/disk/by-id/scsi-1SCST_BIOa234eea9-c39e6722ab25b9d5', '/dev/disk/by-id/scsi-26333396536373232') {{(pid=85991) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[119ab826-796e-4016-aabe-ca8dc146b891]: (4, None) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed47413-910d-4355-b569-b806f2ecf45d]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e291599d-eef8-4009-85d0-edd1ffc3226b]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6, portal: 172.16.0.220,3260]
Nov 16 01:07:58 user nova-compute[75826]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6, portal: 172.16.0.220,3260] successful.
Nov 16 01:07:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e0cbb2ef-5696-44f9-84e0-341d15776ce6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd94656-95c7-4463-bcbb-7f68ee2ae6f5]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== disconnect_volume: return (335ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:07:58 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Deleting instance files /opt/stack/data/nova/instances/f8d5b1fd-65b2-4c87-abee-e988451f8ab8_del
Nov 16 01:07:58 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Deletion of /opt/stack/data/nova/instances/f8d5b1fd-65b2-4c87-abee-e988451f8ab8_del complete
Nov 16 01:07:58 user nova-compute[75826]: INFO nova.compute.manager [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Took 1.21 seconds to destroy the instance on the hypervisor.
Nov 16 01:07:58 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:07:58 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Took 0.46 seconds to deallocate network for instance.
Nov 16 01:07:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-63c66aa7-c291-48ee-8eb0-24555e2bae0c req-e109a2ff-658b-48b4-a4eb-14b953888059 service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Received event network-vif-deleted-e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:58 user nova-compute[75826]: INFO nova.compute.manager [req-63c66aa7-c291-48ee-8eb0-24555e2bae0c req-e109a2ff-658b-48b4-a4eb-14b953888059 service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Neutron deleted interface e2b7c661-0f79-4431-8440-c7ad6f36e91e; detaching it from the instance and deleting it from the info cache
Nov 16 01:07:58 user nova-compute[75826]: DEBUG nova.network.neutron [req-63c66aa7-c291-48ee-8eb0-24555e2bae0c req-e109a2ff-658b-48b4-a4eb-14b953888059 service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:07:58 user nova-compute[75826]: DEBUG nova.compute.manager [req-63c66aa7-c291-48ee-8eb0-24555e2bae0c req-e109a2ff-658b-48b4-a4eb-14b953888059 service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Detach interface failed, port_id=e2b7c661-0f79-4431-8440-c7ad6f36e91e, reason: Instance f8d5b1fd-65b2-4c87-abee-e988451f8ab8 could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-92cc2beb-88b1-4102-81ef-c410bd02874d req-ad286eb0-53bc-4418-ad02-37f4639a849f service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Received event network-vif-unplugged-e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-92cc2beb-88b1-4102-81ef-c410bd02874d req-ad286eb0-53bc-4418-ad02-37f4639a849f service nova] Acquiring lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-92cc2beb-88b1-4102-81ef-c410bd02874d req-ad286eb0-53bc-4418-ad02-37f4639a849f service nova] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-92cc2beb-88b1-4102-81ef-c410bd02874d req-ad286eb0-53bc-4418-ad02-37f4639a849f service nova] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-92cc2beb-88b1-4102-81ef-c410bd02874d req-ad286eb0-53bc-4418-ad02-37f4639a849f service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] No waiting events found dispatching network-vif-unplugged-e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-92cc2beb-88b1-4102-81ef-c410bd02874d req-ad286eb0-53bc-4418-ad02-37f4639a849f service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Received event network-vif-unplugged-e2b7c661-0f79-4431-8440-c7ad6f36e91e for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-92cc2beb-88b1-4102-81ef-c410bd02874d req-ad286eb0-53bc-4418-ad02-37f4639a849f service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Received event network-vif-plugged-e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-92cc2beb-88b1-4102-81ef-c410bd02874d req-ad286eb0-53bc-4418-ad02-37f4639a849f service nova] Acquiring lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-92cc2beb-88b1-4102-81ef-c410bd02874d req-ad286eb0-53bc-4418-ad02-37f4639a849f service nova] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-92cc2beb-88b1-4102-81ef-c410bd02874d req-ad286eb0-53bc-4418-ad02-37f4639a849f service nova] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-92cc2beb-88b1-4102-81ef-c410bd02874d req-ad286eb0-53bc-4418-ad02-37f4639a849f service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] No waiting events found dispatching network-vif-plugged-e2b7c661-0f79-4431-8440-c7ad6f36e91e {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:07:59 user nova-compute[75826]: WARNING nova.compute.manager [req-92cc2beb-88b1-4102-81ef-c410bd02874d req-ad286eb0-53bc-4418-ad02-37f4639a849f service nova] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Received unexpected event network-vif-plugged-e2b7c661-0f79-4431-8440-c7ad6f36e91e for instance with vm_state active and task_state deleting.
Nov 16 01:07:59 user nova-compute[75826]: INFO nova.compute.manager [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: f8d5b1fd-65b2-4c87-abee-e988451f8ab8] Took 0.84 seconds to detach 1 volumes for instance.
Nov 16 01:07:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:07:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.135s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:07:59 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Deleted allocations for instance f8d5b1fd-65b2-4c87-abee-e988451f8ab8
Nov 16 01:08:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-02be1809-a007-4a32-96d2-de474a5a1dec tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "f8d5b1fd-65b2-4c87-abee-e988451f8ab8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.883s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:08:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:08:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:08:18 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:08:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:08:21 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:08:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:08:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:08:21 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:08:21 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Updating instance_info_cache with network_info: [{"id": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "address": "fa:16:3e:e6:4b:6e", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3741ee96-4a", "ovs_interfaceid": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:08:21 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:08:21 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:08:23 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:08:23 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:08:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=8941MB free_disk=25.23708724975586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance e39ea0c5-98bb-4a7f-acca-2812445d0d46 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:08:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:24 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:08:26 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:08:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:08:28 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:08:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:31 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:08:31 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:08:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:33 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:08:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "620407a6-58c6-498a-b046-d649bceaa04f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "620407a6-58c6-498a-b046-d649bceaa04f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:33 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 01:08:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:33 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 01:08:33 user nova-compute[75826]: INFO nova.compute.claims [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Claim successful on node user
Nov 16 01:08:34 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG nova.network.neutron [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 01:08:34 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 01:08:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG nova.policy [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a11fec083364dd492810f1e98506603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81f5329aa3403abb08e33e6a75b210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 01:08:34 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Creating image(s)
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "/opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "/opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "/opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.190s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk 1073741824" returned: 0 in 0.050s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:34 user nova-compute[75826]: DEBUG nova.network.neutron [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Successfully created port: 903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Cannot resize image /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Ensure instance console log exists: /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.network.neutron [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Successfully updated port: 903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "refresh_cache-620407a6-58c6-498a-b046-d649bceaa04f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquired lock "refresh_cache-620407a6-58c6-498a-b046-d649bceaa04f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.network.neutron [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-93fd29ff-4f6f-419c-8e12-84218cf27a60 req-f9479d52-ef64-4ff0-8809-7a02d724ea6a service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Received event network-changed-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.compute.manager [req-93fd29ff-4f6f-419c-8e12-84218cf27a60 req-f9479d52-ef64-4ff0-8809-7a02d724ea6a service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Refreshing instance network info cache due to event network-changed-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-93fd29ff-4f6f-419c-8e12-84218cf27a60 req-f9479d52-ef64-4ff0-8809-7a02d724ea6a service nova] Acquiring lock "refresh_cache-620407a6-58c6-498a-b046-d649bceaa04f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.network.neutron [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.network.neutron [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Updating instance_info_cache with network_info: [{"id": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "address": "fa:16:3e:5b:91:81", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903935a2-0e", "ovs_interfaceid": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Releasing lock "refresh_cache-620407a6-58c6-498a-b046-d649bceaa04f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Instance network_info: |[{"id": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "address": "fa:16:3e:5b:91:81", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903935a2-0e", "ovs_interfaceid": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-93fd29ff-4f6f-419c-8e12-84218cf27a60 req-f9479d52-ef64-4ff0-8809-7a02d724ea6a service nova] Acquired lock "refresh_cache-620407a6-58c6-498a-b046-d649bceaa04f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.network.neutron [req-93fd29ff-4f6f-419c-8e12-84218cf27a60 req-f9479d52-ef64-4ff0-8809-7a02d724ea6a service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Refreshing network info cache for port 903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Start _get_guest_xml network_info=[{"id": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "address": "fa:16:3e:5b:91:81", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903935a2-0e", "ovs_interfaceid": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 01:08:35 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:08:35 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-900415987',display_name='tempest-VolumesActionsTest-instance-900415987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-900415987',id=49,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb81f5329aa3403abb08e33e6a75b210',ramdisk_id='',reservation_id='r-bbvh2j09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-687556528',owner_user_name='tempest-VolumesActionsTest-687556528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:08:34Z,user_data=None,user_id='9a11fec083364dd492810f1e98506603',uuid=620407a6-58c6-498a-b046-d649bceaa04f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "address": "fa:16:3e:5b:91:81", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903935a2-0e", "ovs_interfaceid": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Converting VIF {"id": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "address": "fa:16:3e:5b:91:81", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903935a2-0e", "ovs_interfaceid": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:91:81,bridge_name='br-int',has_traffic_filtering=True,id=903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903935a2-0e') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.objects.instance [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lazy-loading 'pci_devices' on Instance uuid 620407a6-58c6-498a-b046-d649bceaa04f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] End _get_guest_xml xml=<domain type="kvm">
Nov 16 01:08:35 user nova-compute[75826]:   <uuid>620407a6-58c6-498a-b046-d649bceaa04f</uuid>
Nov 16 01:08:35 user nova-compute[75826]:   <name>instance-00000031</name>
Nov 16 01:08:35 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 01:08:35 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 01:08:35 user nova-compute[75826]:   <metadata>
Nov 16 01:08:35 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 01:08:35 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 01:08:35 user nova-compute[75826]:       <nova:name>tempest-VolumesActionsTest-instance-900415987</nova:name>
Nov 16 01:08:35 user nova-compute[75826]:       <nova:creationTime>2023-11-16 01:08:35</nova:creationTime>
Nov 16 01:08:35 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 01:08:35 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 01:08:35 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 01:08:35 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 01:08:35 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 01:08:35 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 01:08:35 user nova-compute[75826]:       </nova:flavor>
Nov 16 01:08:35 user nova-compute[75826]:       <nova:owner>
Nov 16 01:08:35 user nova-compute[75826]:         <nova:user uuid="9a11fec083364dd492810f1e98506603">tempest-VolumesActionsTest-687556528-project-member</nova:user>
Nov 16 01:08:35 user nova-compute[75826]:         <nova:project uuid="cb81f5329aa3403abb08e33e6a75b210">tempest-VolumesActionsTest-687556528</nova:project>
Nov 16 01:08:35 user nova-compute[75826]:       </nova:owner>
Nov 16 01:08:35 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 01:08:35 user nova-compute[75826]:       <nova:ports>
Nov 16 01:08:35 user nova-compute[75826]:         <nova:port uuid="903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76">
Nov 16 01:08:35 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 16 01:08:35 user nova-compute[75826]:         </nova:port>
Nov 16 01:08:35 user nova-compute[75826]:       </nova:ports>
Nov 16 01:08:35 user nova-compute[75826]:     </nova:instance>
Nov 16 01:08:35 user nova-compute[75826]:   </metadata>
Nov 16 01:08:35 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 01:08:35 user nova-compute[75826]:     <system>
Nov 16 01:08:35 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 01:08:35 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 01:08:35 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 01:08:35 user nova-compute[75826]:       <entry name="serial">620407a6-58c6-498a-b046-d649bceaa04f</entry>
Nov 16 01:08:35 user nova-compute[75826]:       <entry name="uuid">620407a6-58c6-498a-b046-d649bceaa04f</entry>
Nov 16 01:08:35 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 01:08:35 user nova-compute[75826]:     </system>
Nov 16 01:08:35 user nova-compute[75826]:   </sysinfo>
Nov 16 01:08:35 user nova-compute[75826]:   <os>
Nov 16 01:08:35 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 01:08:35 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 01:08:35 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 01:08:35 user nova-compute[75826]:   </os>
Nov 16 01:08:35 user nova-compute[75826]:   <features>
Nov 16 01:08:35 user nova-compute[75826]:     <acpi/>
Nov 16 01:08:35 user nova-compute[75826]:     <apic/>
Nov 16 01:08:35 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 01:08:35 user nova-compute[75826]:   </features>
Nov 16 01:08:35 user nova-compute[75826]:   <clock offset="utc">
Nov 16 01:08:35 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 01:08:35 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 01:08:35 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 01:08:35 user nova-compute[75826]:   </clock>
Nov 16 01:08:35 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 01:08:35 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 01:08:35 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 01:08:35 user nova-compute[75826]:   </cpu>
Nov 16 01:08:35 user nova-compute[75826]:   <devices>
Nov 16 01:08:35 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 01:08:35 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 01:08:35 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk"/>
Nov 16 01:08:35 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 01:08:35 user nova-compute[75826]:     </disk>
Nov 16 01:08:35 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 01:08:35 user nova-compute[75826]:       <mac address="fa:16:3e:5b:91:81"/>
Nov 16 01:08:35 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:08:35 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 01:08:35 user nova-compute[75826]:       <target dev="tap903935a2-0e"/>
Nov 16 01:08:35 user nova-compute[75826]:     </interface>
Nov 16 01:08:35 user nova-compute[75826]:     <serial type="pty">
Nov 16 01:08:35 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/console.log" append="off"/>
Nov 16 01:08:35 user nova-compute[75826]:     </serial>
Nov 16 01:08:35 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 01:08:35 user nova-compute[75826]:     <video>
Nov 16 01:08:35 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:08:35 user nova-compute[75826]:     </video>
Nov 16 01:08:35 user nova-compute[75826]:     <rng model="virtio">
Nov 16 01:08:35 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 01:08:35 user nova-compute[75826]:     </rng>
Nov 16 01:08:35 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 01:08:35 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 01:08:35 user nova-compute[75826]:       <stats period="10"/>
Nov 16 01:08:35 user nova-compute[75826]:     </memballoon>
Nov 16 01:08:35 user nova-compute[75826]:   </devices>
Nov 16 01:08:35 user nova-compute[75826]: </domain>
Nov 16 01:08:35 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-900415987',display_name='tempest-VolumesActionsTest-instance-900415987',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-900415987',id=49,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb81f5329aa3403abb08e33e6a75b210',ramdisk_id='',reservation_id='r-bbvh2j09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-687556528',owner_user_name='tempest-VolumesActionsTest-687556528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:08:34Z,user_data=None,user_id='9a11fec083364dd492810f1e98506603',uuid=620407a6-58c6-498a-b046-d649bceaa04f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "address": "fa:16:3e:5b:91:81", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903935a2-0e", "ovs_interfaceid": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Converting VIF {"id": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "address": "fa:16:3e:5b:91:81", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903935a2-0e", "ovs_interfaceid": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:91:81,bridge_name='br-int',has_traffic_filtering=True,id=903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903935a2-0e') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG os_vif [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:91:81,bridge_name='br-int',has_traffic_filtering=True,id=903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903935a2-0e') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94ac72b7-8f02-5d7d-b5c6-6b77055abc5c', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap903935a2-0e, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap903935a2-0e, col_values=(('qos', UUID('8f799475-fe19-4c27-a77b-74d5abd2e66f')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap903935a2-0e, col_values=(('external_ids', {'iface-id': '903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:91:81', 'vm-uuid': '620407a6-58c6-498a-b046-d649bceaa04f'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:08:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:08:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:36 user nova-compute[75826]: INFO os_vif [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:91:81,bridge_name='br-int',has_traffic_filtering=True,id=903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903935a2-0e')
Nov 16 01:08:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:08:36 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] No VIF found with MAC fa:16:3e:5b:91:81, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:08:36 user nova-compute[75826]: DEBUG nova.network.neutron [req-93fd29ff-4f6f-419c-8e12-84218cf27a60 req-f9479d52-ef64-4ff0-8809-7a02d724ea6a service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Updated VIF entry in instance network info cache for port 903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:08:36 user nova-compute[75826]: DEBUG nova.network.neutron [req-93fd29ff-4f6f-419c-8e12-84218cf27a60 req-f9479d52-ef64-4ff0-8809-7a02d724ea6a service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Updating instance_info_cache with network_info: [{"id": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "address": "fa:16:3e:5b:91:81", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903935a2-0e", "ovs_interfaceid": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:08:36 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-93fd29ff-4f6f-419c-8e12-84218cf27a60 req-f9479d52-ef64-4ff0-8809-7a02d724ea6a service nova] Releasing lock "refresh_cache-620407a6-58c6-498a-b046-d649bceaa04f" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:08:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:37 user nova-compute[75826]: DEBUG nova.compute.manager [req-1454eec0-11e2-4281-a353-a64c7ca61490 req-4b1c8a3d-a911-4206-bc6d-f75d9d79022c service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Received event network-vif-plugged-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:08:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1454eec0-11e2-4281-a353-a64c7ca61490 req-4b1c8a3d-a911-4206-bc6d-f75d9d79022c service nova] Acquiring lock "620407a6-58c6-498a-b046-d649bceaa04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1454eec0-11e2-4281-a353-a64c7ca61490 req-4b1c8a3d-a911-4206-bc6d-f75d9d79022c service nova] Lock "620407a6-58c6-498a-b046-d649bceaa04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:37 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-1454eec0-11e2-4281-a353-a64c7ca61490 req-4b1c8a3d-a911-4206-bc6d-f75d9d79022c service nova] Lock "620407a6-58c6-498a-b046-d649bceaa04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:37 user nova-compute[75826]: DEBUG nova.compute.manager [req-1454eec0-11e2-4281-a353-a64c7ca61490 req-4b1c8a3d-a911-4206-bc6d-f75d9d79022c service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] No waiting events found dispatching network-vif-plugged-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:08:37 user nova-compute[75826]: WARNING nova.compute.manager [req-1454eec0-11e2-4281-a353-a64c7ca61490 req-4b1c8a3d-a911-4206-bc6d-f75d9d79022c service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Received unexpected event network-vif-plugged-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 for instance with vm_state building and task_state spawning.
Nov 16 01:08:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 01:08:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 01:08:39 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Instance spawned successfully.
Nov 16 01:08:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 01:08:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:08:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:08:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:08:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:08:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:08:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:08:39 user nova-compute[75826]: INFO nova.compute.manager [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Took 5.07 seconds to spawn the instance on the hypervisor.
Nov 16 01:08:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:08:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-9fb74e63-dc9b-4dfb-bcfb-8d1e894c3a8e req-13f2f657-56ca-4372-a0c6-f93036359a60 service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Received event network-vif-plugged-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:08:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9fb74e63-dc9b-4dfb-bcfb-8d1e894c3a8e req-13f2f657-56ca-4372-a0c6-f93036359a60 service nova] Acquiring lock "620407a6-58c6-498a-b046-d649bceaa04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9fb74e63-dc9b-4dfb-bcfb-8d1e894c3a8e req-13f2f657-56ca-4372-a0c6-f93036359a60 service nova] Lock "620407a6-58c6-498a-b046-d649bceaa04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9fb74e63-dc9b-4dfb-bcfb-8d1e894c3a8e req-13f2f657-56ca-4372-a0c6-f93036359a60 service nova] Lock "620407a6-58c6-498a-b046-d649bceaa04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-9fb74e63-dc9b-4dfb-bcfb-8d1e894c3a8e req-13f2f657-56ca-4372-a0c6-f93036359a60 service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] No waiting events found dispatching network-vif-plugged-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:08:39 user nova-compute[75826]: WARNING nova.compute.manager [req-9fb74e63-dc9b-4dfb-bcfb-8d1e894c3a8e req-13f2f657-56ca-4372-a0c6-f93036359a60 service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Received unexpected event network-vif-plugged-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 for instance with vm_state building and task_state spawning.
Nov 16 01:08:39 user nova-compute[75826]: INFO nova.compute.manager [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Took 5.67 seconds to build instance.
Nov 16 01:08:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-bea578f3-e797-46a3-bf13-e343d92809e5 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "620407a6-58c6-498a-b046-d649bceaa04f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.786s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:08:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:08:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:08:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:08:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-947d665e-50b3-4805-9f8c-bb242fd07cd0 req-5cae761b-e7da-4adc-a697-6e041c67f90e service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-changed-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-947d665e-50b3-4805-9f8c-bb242fd07cd0 req-5cae761b-e7da-4adc-a697-6e041c67f90e service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Refreshing instance network info cache due to event network-changed-3741ee96-4a17-46ef-91af-83a9fdb711b3. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-947d665e-50b3-4805-9f8c-bb242fd07cd0 req-5cae761b-e7da-4adc-a697-6e041c67f90e service nova] Acquiring lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-947d665e-50b3-4805-9f8c-bb242fd07cd0 req-5cae761b-e7da-4adc-a697-6e041c67f90e service nova] Acquired lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG nova.network.neutron [req-947d665e-50b3-4805-9f8c-bb242fd07cd0 req-5cae761b-e7da-4adc-a697-6e041c67f90e service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Refreshing network info cache for port 3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:57 user nova-compute[75826]: INFO nova.compute.manager [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Terminating instance
Nov 16 01:08:57 user nova-compute[75826]: DEBUG nova.compute.manager [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-5bb2febd-a759-4931-ac6a-67bafe6fbadb req-dc8ce3e9-26b5-4fa3-bb5a-ae01ab5f4dbb service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-vif-unplugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5bb2febd-a759-4931-ac6a-67bafe6fbadb req-dc8ce3e9-26b5-4fa3-bb5a-ae01ab5f4dbb service nova] Acquiring lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5bb2febd-a759-4931-ac6a-67bafe6fbadb req-dc8ce3e9-26b5-4fa3-bb5a-ae01ab5f4dbb service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5bb2febd-a759-4931-ac6a-67bafe6fbadb req-dc8ce3e9-26b5-4fa3-bb5a-ae01ab5f4dbb service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-5bb2febd-a759-4931-ac6a-67bafe6fbadb req-dc8ce3e9-26b5-4fa3-bb5a-ae01ab5f4dbb service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] No waiting events found dispatching network-vif-unplugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-5bb2febd-a759-4931-ac6a-67bafe6fbadb req-dc8ce3e9-26b5-4fa3-bb5a-ae01ab5f4dbb service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-vif-unplugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG nova.network.neutron [req-947d665e-50b3-4805-9f8c-bb242fd07cd0 req-5cae761b-e7da-4adc-a697-6e041c67f90e service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Updated VIF entry in instance network info cache for port 3741ee96-4a17-46ef-91af-83a9fdb711b3. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG nova.network.neutron [req-947d665e-50b3-4805-9f8c-bb242fd07cd0 req-5cae761b-e7da-4adc-a697-6e041c67f90e service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Updating instance_info_cache with network_info: [{"id": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "address": "fa:16:3e:e6:4b:6e", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3741ee96-4a", "ovs_interfaceid": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-947d665e-50b3-4805-9f8c-bb242fd07cd0 req-5cae761b-e7da-4adc-a697-6e041c67f90e service nova] Releasing lock "refresh_cache-e39ea0c5-98bb-4a7f-acca-2812445d0d46" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:57 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Instance destroyed successfully.
Nov 16 01:08:57 user nova-compute[75826]: DEBUG nova.objects.instance [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lazy-loading 'resources' on Instance uuid e39ea0c5-98bb-4a7f-acca-2812445d0d46 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:04:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-309470699',display_name='tempest-TestVolumeBootPattern-server-309470699',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-309470699',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGm3ahxdyhMyQRGdodmVB4rNyVTsBs9l2wJPImRwyG338XqNyzGOLQ50rip2YKesURLjC0iv5HRzeJcmp1NyHE7ZZ5taylxF05FJcu5bUEFb8Cv7u/1iu868o42QyRdnsQ==',key_name='tempest-TestVolumeBootPattern-1182608151',keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:04:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ef4135693756414fb70826b0f1d9345c',ramdisk_id='',reservation_id='r-p74mqspl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-2108626012',owner_user_name='tempest-TestVolumeBootPattern-2108626012-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:04:14Z,user_data=None,user_id='6c17265442bc48f9b6de5367e91096b2',uuid=e39ea0c5-98bb-4a7f-acca-2812445d0d46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "address": "fa:16:3e:e6:4b:6e", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3741ee96-4a", "ovs_interfaceid": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converting VIF {"id": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "address": "fa:16:3e:e6:4b:6e", "network": {"id": "4ba053cf-51a6-4b19-9bf9-61a5f5952f94", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1059688796-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ef4135693756414fb70826b0f1d9345c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3741ee96-4a", "ovs_interfaceid": "3741ee96-4a17-46ef-91af-83a9fdb711b3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:4b:6e,bridge_name='br-int',has_traffic_filtering=True,id=3741ee96-4a17-46ef-91af-83a9fdb711b3,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3741ee96-4a') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:08:57 user nova-compute[75826]: DEBUG os_vif [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:4b:6e,bridge_name='br-int',has_traffic_filtering=True,id=3741ee96-4a17-46ef-91af-83a9fdb711b3,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3741ee96-4a') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3741ee96-4a, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55958e83-ad41-46e2-9c67-6d3e900157eb) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:08:58 user nova-compute[75826]: INFO os_vif [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:4b:6e,bridge_name='br-int',has_traffic_filtering=True,id=3741ee96-4a17-46ef-91af-83a9fdb711b3,network=Network(4ba053cf-51a6-4b19-9bf9-61a5f5952f94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3741ee96-4a')
Nov 16 01:08:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEiqpoGe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:08:58 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5b3346-d1d3-49cc-a4c8-3a8e8716aba9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:08:58 user nova-compute[75826]: No targets found.
Nov 16 01:08:58 user nova-compute[75826]: iSNS:
Nov 16 01:08:58 user nova-compute[75826]: No targets found.
Nov 16 01:08:58 user nova-compute[75826]: STATIC:
Nov 16 01:08:58 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6
Nov 16 01:08:58 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:08:58 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:08:58 user nova-compute[75826]: FIRMWARE:
Nov 16 01:08:58 user nova-compute[75826]: No targets found.
Nov 16 01:08:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:08:58 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:08:58 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[def2c23c-4c10-4b73-9bbd-30789e853f8d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe17c9c-ed97-4381-9b99-01dcb0ea0c51]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:08:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 (non-flash)
Nov 16 01:08:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd944be9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6'): ({'sdb'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Removing single pathed devices sdb {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f388db-47fa-4190-a804-8dc2d9553eb0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[2739c5ab-03d6-480f-a358-9c6138542fd4]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Flushing IO for device /dev/sdb {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7db4c1-3679-4e88-819a-d23db2659d89]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[659baac8-fe1d-4eb0-86b9-d159403f887a]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3eef3e-0d0f-4582-b329-fb4d29a8e7ff]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda7661f-4137-4735-a808-1213f78d79fa]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260]
Nov 16 01:08:58 user nova-compute[75826]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6, portal: 172.16.0.220,3260] successful.
Nov 16 01:08:58 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b37fc46e-6c9d-45a0-93b9-9182c0453ff6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9324e8f-3e2e-4875-8bb5-03ca95418b00]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] <== disconnect_volume: return (339ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:08:58 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Deleting instance files /opt/stack/data/nova/instances/e39ea0c5-98bb-4a7f-acca-2812445d0d46_del
Nov 16 01:08:58 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Deletion of /opt/stack/data/nova/instances/e39ea0c5-98bb-4a7f-acca-2812445d0d46_del complete
Nov 16 01:08:58 user nova-compute[75826]: INFO nova.compute.manager [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 16 01:08:58 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:08:59 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Took 0.76 seconds to deallocate network for instance.
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-6e317501-d145-45fa-b3b8-1328d04bf4a3 req-69cae5dd-e801-4697-9125-e249811731d2 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-vif-deleted-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:08:59 user nova-compute[75826]: INFO nova.compute.manager [req-6e317501-d145-45fa-b3b8-1328d04bf4a3 req-69cae5dd-e801-4697-9125-e249811731d2 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Neutron deleted interface 3741ee96-4a17-46ef-91af-83a9fdb711b3; detaching it from the instance and deleting it from the info cache
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.network.neutron [req-6e317501-d145-45fa-b3b8-1328d04bf4a3 req-69cae5dd-e801-4697-9125-e249811731d2 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-6e317501-d145-45fa-b3b8-1328d04bf4a3 req-69cae5dd-e801-4697-9125-e249811731d2 service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Detach interface failed, port_id=3741ee96-4a17-46ef-91af-83a9fdb711b3, reason: Instance e39ea0c5-98bb-4a7f-acca-2812445d0d46 could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Acquiring lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] No waiting events found dispatching network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:08:59 user nova-compute[75826]: WARNING nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received unexpected event network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 for instance with vm_state active and task_state deleting.
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Acquiring lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] No waiting events found dispatching network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:08:59 user nova-compute[75826]: WARNING nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received unexpected event network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 for instance with vm_state active and task_state deleting.
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Acquiring lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] No waiting events found dispatching network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:08:59 user nova-compute[75826]: WARNING nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received unexpected event network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 for instance with vm_state active and task_state deleting.
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-vif-unplugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Acquiring lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] No waiting events found dispatching network-vif-unplugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-vif-unplugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received event network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Acquiring lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:08:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] No waiting events found dispatching network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:08:59 user nova-compute[75826]: WARNING nova.compute.manager [req-6db1eeed-7d81-4541-87d2-6e8192dfd4b7 req-ff329d7e-558c-4041-b7c9-27367007a2bc service nova] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Received unexpected event network-vif-plugged-3741ee96-4a17-46ef-91af-83a9fdb711b3 for instance with vm_state active and task_state deleting.
Nov 16 01:09:00 user nova-compute[75826]: INFO nova.compute.manager [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] [instance: e39ea0c5-98bb-4a7f-acca-2812445d0d46] Took 0.92 seconds to detach 1 volumes for instance.
Nov 16 01:09:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:09:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:09:00 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:09:00 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:09:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:09:00 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Deleted allocations for instance e39ea0c5-98bb-4a7f-acca-2812445d0d46
Nov 16 01:09:00 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-94996b86-f16a-40fd-b0b8-02f891e299a2 tempest-TestVolumeBootPattern-2108626012 tempest-TestVolumeBootPattern-2108626012-project-member] Lock "e39ea0c5-98bb-4a7f-acca-2812445d0d46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.301s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:09:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:18 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:09:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:09:23 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:09:23 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:09:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=8954MB free_disk=25.237136840820312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:09:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:09:24 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 620407a6-58c6-498a-b046-d649bceaa04f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:09:24 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:09:24 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:09:24 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:09:24 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:09:24 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:09:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:09:25 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:09:25 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:09:27 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:09:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:09:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:09:31 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:09:31 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:09:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:09:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:09:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:09:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:09:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:09:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:09:34 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:09:35 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:09:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:09:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:09:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:09:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:09:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:09:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:09:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:09:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:09:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:09:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:09:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:09:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:09:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:09:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:09:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:09:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:09:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:09:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:10:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:10:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:10:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:10:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:10:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:10:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:10:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:10:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:10:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:10:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:10:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:10:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:18 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:10:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:10:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:10:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:10:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:10:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:10:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:23 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:10:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:10:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:10:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:10:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:10:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:10:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:10:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:10:23 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:10:23 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:10:23 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:10:23 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9064MB free_disk=25.235916137695312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:10:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:10:23 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 620407a6-58c6-498a-b046-d649bceaa04f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "620407a6-58c6-498a-b046-d649bceaa04f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "620407a6-58c6-498a-b046-d649bceaa04f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "620407a6-58c6-498a-b046-d649bceaa04f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "620407a6-58c6-498a-b046-d649bceaa04f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "620407a6-58c6-498a-b046-d649bceaa04f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing inventories for resource provider 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 01:10:24 user nova-compute[75826]: INFO nova.compute.manager [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Terminating instance
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.compute.manager [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating ProviderTree inventory for provider 015246d3-5250-41ea-8943-b837ba3f5938 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating inventory in ProviderTree for provider 015246d3-5250-41ea-8943-b837ba3f5938 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing aggregate associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, aggregates: None {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing trait associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-445c8cd1-9052-4a0e-91db-cdc9de1ea41a req-b0163bb4-2944-4e79-a6b7-972f162e38b3 service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Received event network-vif-unplugged-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-445c8cd1-9052-4a0e-91db-cdc9de1ea41a req-b0163bb4-2944-4e79-a6b7-972f162e38b3 service nova] Acquiring lock "620407a6-58c6-498a-b046-d649bceaa04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-445c8cd1-9052-4a0e-91db-cdc9de1ea41a req-b0163bb4-2944-4e79-a6b7-972f162e38b3 service nova] Lock "620407a6-58c6-498a-b046-d649bceaa04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-445c8cd1-9052-4a0e-91db-cdc9de1ea41a req-b0163bb4-2944-4e79-a6b7-972f162e38b3 service nova] Lock "620407a6-58c6-498a-b046-d649bceaa04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-445c8cd1-9052-4a0e-91db-cdc9de1ea41a req-b0163bb4-2944-4e79-a6b7-972f162e38b3 service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] No waiting events found dispatching network-vif-unplugged-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-445c8cd1-9052-4a0e-91db-cdc9de1ea41a req-b0163bb4-2944-4e79-a6b7-972f162e38b3 service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Received event network-vif-unplugged-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:24 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Instance destroyed successfully.
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.objects.instance [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lazy-loading 'resources' on Instance uuid 620407a6-58c6-498a-b046-d649bceaa04f {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:08:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-900415987',display_name='tempest-VolumesActionsTest-instance-900415987',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-900415987',id=49,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:08:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb81f5329aa3403abb08e33e6a75b210',ramdisk_id='',reservation_id='r-bbvh2j09',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-687556528',owner_user_name='tempest-VolumesActionsTest-687556528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:08:40Z,user_data=None,user_id='9a11fec083364dd492810f1e98506603',uuid=620407a6-58c6-498a-b046-d649bceaa04f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "address": "fa:16:3e:5b:91:81", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903935a2-0e", "ovs_interfaceid": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Converting VIF {"id": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "address": "fa:16:3e:5b:91:81", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap903935a2-0e", "ovs_interfaceid": "903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:91:81,bridge_name='br-int',has_traffic_filtering=True,id=903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903935a2-0e') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:10:24 user nova-compute[75826]: DEBUG os_vif [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:91:81,bridge_name='br-int',has_traffic_filtering=True,id=903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903935a2-0e') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap903935a2-0e, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8f799475-fe19-4c27-a77b-74d5abd2e66f) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:10:25 user nova-compute[75826]: INFO os_vif [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:91:81,bridge_name='br-int',has_traffic_filtering=True,id=903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap903935a2-0e')
Nov 16 01:10:25 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Deleting instance files /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f_del
Nov 16 01:10:25 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Deletion of /opt/stack/data/nova/instances/620407a6-58c6-498a-b046-d649bceaa04f_del complete
Nov 16 01:10:25 user nova-compute[75826]: INFO nova.compute.manager [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 01:10:25 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Skipping network cache update for instance because it is being deleted. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:10:25 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Took 0.51 seconds to deallocate network for instance.
Nov 16 01:10:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-56d6e447-4246-4949-8929-147e4b2602ac req-ae447fb6-94ef-4c7a-a7b5-26e1aad0678f service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Received event network-vif-deleted-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:10:25 user nova-compute[75826]: INFO nova.compute.manager [req-56d6e447-4246-4949-8929-147e4b2602ac req-ae447fb6-94ef-4c7a-a7b5-26e1aad0678f service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Neutron deleted interface 903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76; detaching it from the instance and deleting it from the info cache
Nov 16 01:10:25 user nova-compute[75826]: DEBUG nova.network.neutron [req-56d6e447-4246-4949-8929-147e4b2602ac req-ae447fb6-94ef-4c7a-a7b5-26e1aad0678f service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-56d6e447-4246-4949-8929-147e4b2602ac req-ae447fb6-94ef-4c7a-a7b5-26e1aad0678f service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Detach interface failed, port_id=903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76, reason: Instance 620407a6-58c6-498a-b046-d649bceaa04f could not be found. {{(pid=75826) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:10:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.107s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:10:25 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Deleted allocations for instance 620407a6-58c6-498a-b046-d649bceaa04f
Nov 16 01:10:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-440a7b06-7464-46fd-9c1e-64185c7a7bd4 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "620407a6-58c6-498a-b046-d649bceaa04f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.674s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:10:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-2c75e265-8538-404d-a921-7e4dfe6ede01 req-fce76dae-fe56-4130-ab4d-24650e5fe825 service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Received event network-vif-plugged-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:10:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2c75e265-8538-404d-a921-7e4dfe6ede01 req-fce76dae-fe56-4130-ab4d-24650e5fe825 service nova] Acquiring lock "620407a6-58c6-498a-b046-d649bceaa04f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:10:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2c75e265-8538-404d-a921-7e4dfe6ede01 req-fce76dae-fe56-4130-ab4d-24650e5fe825 service nova] Lock "620407a6-58c6-498a-b046-d649bceaa04f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:10:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2c75e265-8538-404d-a921-7e4dfe6ede01 req-fce76dae-fe56-4130-ab4d-24650e5fe825 service nova] Lock "620407a6-58c6-498a-b046-d649bceaa04f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:10:26 user nova-compute[75826]: DEBUG nova.compute.manager [req-2c75e265-8538-404d-a921-7e4dfe6ede01 req-fce76dae-fe56-4130-ab4d-24650e5fe825 service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] No waiting events found dispatching network-vif-plugged-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:10:26 user nova-compute[75826]: WARNING nova.compute.manager [req-2c75e265-8538-404d-a921-7e4dfe6ede01 req-fce76dae-fe56-4130-ab4d-24650e5fe825 service nova] [instance: 620407a6-58c6-498a-b046-d649bceaa04f] Received unexpected event network-vif-plugged-903935a2-0e90-4e8b-b6d4-f0e7e9bb3b76 for instance with vm_state deleted and task_state None.
Nov 16 01:10:28 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:10:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:10:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75826) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 01:10:32 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:10:33 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:10:33 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:10:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:10:36 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:10:36 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:10:36 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 01:10:36 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] There are 0 instances to clean {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 01:10:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:10:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:10:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:10:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:10:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:10:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:10:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:10:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:11:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:11:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:11:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:11:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:11:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:11:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:11:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "47b3f87f-a50a-4f16-9a26-a0b54036e452" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 01:11:16 user nova-compute[75826]: INFO nova.compute.claims [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Claim successful on node user
Nov 16 01:11:16 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.188s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 01:11:16 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 01:11:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG nova.policy [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9a11fec083364dd492810f1e98506603', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb81f5329aa3403abb08e33e6a75b210', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 01:11:16 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Creating image(s)
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "/opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "/opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "/opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:11:16 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk 1073741824" returned: 0 in 0.050s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Successfully created port: f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Cannot resize image /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Ensure instance console log exists: /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:11:17 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Successfully updated port: f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "refresh_cache-47b3f87f-a50a-4f16-9a26-a0b54036e452" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquired lock "refresh_cache-47b3f87f-a50a-4f16-9a26-a0b54036e452" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.compute.manager [req-518522f4-adf4-45a8-9704-18c4e424b982 req-3c58aee1-d806-4901-8f58-7f0274aa6224 service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received event network-changed-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.compute.manager [req-518522f4-adf4-45a8-9704-18c4e424b982 req-3c58aee1-d806-4901-8f58-7f0274aa6224 service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Refreshing instance network info cache due to event network-changed-f5714dad-6a80-4528-baca-ea4af61fc9f4. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-518522f4-adf4-45a8-9704-18c4e424b982 req-3c58aee1-d806-4901-8f58-7f0274aa6224 service nova] Acquiring lock "refresh_cache-47b3f87f-a50a-4f16-9a26-a0b54036e452" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.network.neutron [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Updating instance_info_cache with network_info: [{"id": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "address": "fa:16:3e:92:81:c0", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5714dad-6a", "ovs_interfaceid": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Releasing lock "refresh_cache-47b3f87f-a50a-4f16-9a26-a0b54036e452" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Instance network_info: |[{"id": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "address": "fa:16:3e:92:81:c0", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5714dad-6a", "ovs_interfaceid": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-518522f4-adf4-45a8-9704-18c4e424b982 req-3c58aee1-d806-4901-8f58-7f0274aa6224 service nova] Acquired lock "refresh_cache-47b3f87f-a50a-4f16-9a26-a0b54036e452" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.network.neutron [req-518522f4-adf4-45a8-9704-18c4e424b982 req-3c58aee1-d806-4901-8f58-7f0274aa6224 service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Refreshing network info cache for port f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Start _get_guest_xml network_info=[{"id": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "address": "fa:16:3e:92:81:c0", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5714dad-6a", "ovs_interfaceid": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 01:11:18 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:11:18 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1856849485',display_name='tempest-VolumesActionsTest-instance-1856849485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1856849485',id=50,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb81f5329aa3403abb08e33e6a75b210',ramdisk_id='',reservation_id='r-yb4kyz30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-687556528',owner_user_name='tempest-VolumesActionsTest-687556528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:11:17Z,user_data=None,user_id='9a11fec083364dd492810f1e98506603',uuid=47b3f87f-a50a-4f16-9a26-a0b54036e452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "address": "fa:16:3e:92:81:c0", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5714dad-6a", "ovs_interfaceid": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Converting VIF {"id": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "address": "fa:16:3e:92:81:c0", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5714dad-6a", "ovs_interfaceid": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:81:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5714dad-6a80-4528-baca-ea4af61fc9f4,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5714dad-6a') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.objects.instance [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lazy-loading 'pci_devices' on Instance uuid 47b3f87f-a50a-4f16-9a26-a0b54036e452 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] End _get_guest_xml xml=<domain type="kvm">
Nov 16 01:11:18 user nova-compute[75826]:   <uuid>47b3f87f-a50a-4f16-9a26-a0b54036e452</uuid>
Nov 16 01:11:18 user nova-compute[75826]:   <name>instance-00000032</name>
Nov 16 01:11:18 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 01:11:18 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 01:11:18 user nova-compute[75826]:   <metadata>
Nov 16 01:11:18 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 01:11:18 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 01:11:18 user nova-compute[75826]:       <nova:name>tempest-VolumesActionsTest-instance-1856849485</nova:name>
Nov 16 01:11:18 user nova-compute[75826]:       <nova:creationTime>2023-11-16 01:11:18</nova:creationTime>
Nov 16 01:11:18 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 01:11:18 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 01:11:18 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 01:11:18 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 01:11:18 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 01:11:18 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 01:11:18 user nova-compute[75826]:       </nova:flavor>
Nov 16 01:11:18 user nova-compute[75826]:       <nova:owner>
Nov 16 01:11:18 user nova-compute[75826]:         <nova:user uuid="9a11fec083364dd492810f1e98506603">tempest-VolumesActionsTest-687556528-project-member</nova:user>
Nov 16 01:11:18 user nova-compute[75826]:         <nova:project uuid="cb81f5329aa3403abb08e33e6a75b210">tempest-VolumesActionsTest-687556528</nova:project>
Nov 16 01:11:18 user nova-compute[75826]:       </nova:owner>
Nov 16 01:11:18 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 01:11:18 user nova-compute[75826]:       <nova:ports>
Nov 16 01:11:18 user nova-compute[75826]:         <nova:port uuid="f5714dad-6a80-4528-baca-ea4af61fc9f4">
Nov 16 01:11:18 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 16 01:11:18 user nova-compute[75826]:         </nova:port>
Nov 16 01:11:18 user nova-compute[75826]:       </nova:ports>
Nov 16 01:11:18 user nova-compute[75826]:     </nova:instance>
Nov 16 01:11:18 user nova-compute[75826]:   </metadata>
Nov 16 01:11:18 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 01:11:18 user nova-compute[75826]:     <system>
Nov 16 01:11:18 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 01:11:18 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 01:11:18 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 01:11:18 user nova-compute[75826]:       <entry name="serial">47b3f87f-a50a-4f16-9a26-a0b54036e452</entry>
Nov 16 01:11:18 user nova-compute[75826]:       <entry name="uuid">47b3f87f-a50a-4f16-9a26-a0b54036e452</entry>
Nov 16 01:11:18 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 01:11:18 user nova-compute[75826]:     </system>
Nov 16 01:11:18 user nova-compute[75826]:   </sysinfo>
Nov 16 01:11:18 user nova-compute[75826]:   <os>
Nov 16 01:11:18 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 01:11:18 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 01:11:18 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 01:11:18 user nova-compute[75826]:   </os>
Nov 16 01:11:18 user nova-compute[75826]:   <features>
Nov 16 01:11:18 user nova-compute[75826]:     <acpi/>
Nov 16 01:11:18 user nova-compute[75826]:     <apic/>
Nov 16 01:11:18 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 01:11:18 user nova-compute[75826]:   </features>
Nov 16 01:11:18 user nova-compute[75826]:   <clock offset="utc">
Nov 16 01:11:18 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 01:11:18 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 01:11:18 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 01:11:18 user nova-compute[75826]:   </clock>
Nov 16 01:11:18 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 01:11:18 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 01:11:18 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 01:11:18 user nova-compute[75826]:   </cpu>
Nov 16 01:11:18 user nova-compute[75826]:   <devices>
Nov 16 01:11:18 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 01:11:18 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 01:11:18 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk"/>
Nov 16 01:11:18 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 01:11:18 user nova-compute[75826]:     </disk>
Nov 16 01:11:18 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 01:11:18 user nova-compute[75826]:       <mac address="fa:16:3e:92:81:c0"/>
Nov 16 01:11:18 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:11:18 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 01:11:18 user nova-compute[75826]:       <target dev="tapf5714dad-6a"/>
Nov 16 01:11:18 user nova-compute[75826]:     </interface>
Nov 16 01:11:18 user nova-compute[75826]:     <serial type="pty">
Nov 16 01:11:18 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/console.log" append="off"/>
Nov 16 01:11:18 user nova-compute[75826]:     </serial>
Nov 16 01:11:18 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 01:11:18 user nova-compute[75826]:     <video>
Nov 16 01:11:18 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:11:18 user nova-compute[75826]:     </video>
Nov 16 01:11:18 user nova-compute[75826]:     <rng model="virtio">
Nov 16 01:11:18 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 01:11:18 user nova-compute[75826]:     </rng>
Nov 16 01:11:18 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 01:11:18 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 01:11:18 user nova-compute[75826]:       <stats period="10"/>
Nov 16 01:11:18 user nova-compute[75826]:     </memballoon>
Nov 16 01:11:18 user nova-compute[75826]:   </devices>
Nov 16 01:11:18 user nova-compute[75826]: </domain>
Nov 16 01:11:18 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1856849485',display_name='tempest-VolumesActionsTest-instance-1856849485',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1856849485',id=50,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cb81f5329aa3403abb08e33e6a75b210',ramdisk_id='',reservation_id='r-yb4kyz30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-687556528',owner_user_name='tempest-VolumesActionsTest-687556528-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:11:17Z,user_data=None,user_id='9a11fec083364dd492810f1e98506603',uuid=47b3f87f-a50a-4f16-9a26-a0b54036e452,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "address": "fa:16:3e:92:81:c0", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5714dad-6a", "ovs_interfaceid": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Converting VIF {"id": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "address": "fa:16:3e:92:81:c0", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5714dad-6a", "ovs_interfaceid": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:81:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5714dad-6a80-4528-baca-ea4af61fc9f4,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5714dad-6a') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG os_vif [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:81:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5714dad-6a80-4528-baca-ea4af61fc9f4,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5714dad-6a') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '60aac912-e073-597a-b766-89cfc66a19cd', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5714dad-6a, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5714dad-6a, col_values=(('qos', UUID('ea5f988a-4fbb-4c2a-a5ab-c7b1eff2a347')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5714dad-6a, col_values=(('external_ids', {'iface-id': 'f5714dad-6a80-4528-baca-ea4af61fc9f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:81:c0', 'vm-uuid': '47b3f87f-a50a-4f16-9a26-a0b54036e452'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:18 user nova-compute[75826]: INFO os_vif [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:81:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5714dad-6a80-4528-baca-ea4af61fc9f4,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5714dad-6a')
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] No VIF found with MAC fa:16:3e:92:81:c0, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.network.neutron [req-518522f4-adf4-45a8-9704-18c4e424b982 req-3c58aee1-d806-4901-8f58-7f0274aa6224 service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Updated VIF entry in instance network info cache for port f5714dad-6a80-4528-baca-ea4af61fc9f4. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG nova.network.neutron [req-518522f4-adf4-45a8-9704-18c4e424b982 req-3c58aee1-d806-4901-8f58-7f0274aa6224 service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Updating instance_info_cache with network_info: [{"id": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "address": "fa:16:3e:92:81:c0", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5714dad-6a", "ovs_interfaceid": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:11:18 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-518522f4-adf4-45a8-9704-18c4e424b982 req-3c58aee1-d806-4901-8f58-7f0274aa6224 service nova] Releasing lock "refresh_cache-47b3f87f-a50a-4f16-9a26-a0b54036e452" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:11:19 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:11:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:20 user nova-compute[75826]: DEBUG nova.compute.manager [req-e4f06d3e-e498-4dac-b579-37e61b2bdd9f req-9d6b1723-3080-4480-aa08-c8246691a41e service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received event network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:11:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e4f06d3e-e498-4dac-b579-37e61b2bdd9f req-9d6b1723-3080-4480-aa08-c8246691a41e service nova] Acquiring lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:11:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e4f06d3e-e498-4dac-b579-37e61b2bdd9f req-9d6b1723-3080-4480-aa08-c8246691a41e service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:11:20 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-e4f06d3e-e498-4dac-b579-37e61b2bdd9f req-9d6b1723-3080-4480-aa08-c8246691a41e service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:11:20 user nova-compute[75826]: DEBUG nova.compute.manager [req-e4f06d3e-e498-4dac-b579-37e61b2bdd9f req-9d6b1723-3080-4480-aa08-c8246691a41e service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] No waiting events found dispatching network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:11:20 user nova-compute[75826]: WARNING nova.compute.manager [req-e4f06d3e-e498-4dac-b579-37e61b2bdd9f req-9d6b1723-3080-4480-aa08-c8246691a41e service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received unexpected event network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 for instance with vm_state building and task_state spawning.
Nov 16 01:11:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:21 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 01:11:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 01:11:21 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Instance spawned successfully.
Nov 16 01:11:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 01:11:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:11:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:11:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:11:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:11:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:11:21 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:11:21 user nova-compute[75826]: INFO nova.compute.manager [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 16 01:11:21 user nova-compute[75826]: DEBUG nova.compute.manager [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:11:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-61482f5f-b691-46fa-8359-334d2d3f8743 req-fee9a41b-91d1-450d-8abb-db615196024b service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received event network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:11:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-61482f5f-b691-46fa-8359-334d2d3f8743 req-fee9a41b-91d1-450d-8abb-db615196024b service nova] Acquiring lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:11:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-61482f5f-b691-46fa-8359-334d2d3f8743 req-fee9a41b-91d1-450d-8abb-db615196024b service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:11:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-61482f5f-b691-46fa-8359-334d2d3f8743 req-fee9a41b-91d1-450d-8abb-db615196024b service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:11:22 user nova-compute[75826]: DEBUG nova.compute.manager [req-61482f5f-b691-46fa-8359-334d2d3f8743 req-fee9a41b-91d1-450d-8abb-db615196024b service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] No waiting events found dispatching network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:11:22 user nova-compute[75826]: WARNING nova.compute.manager [req-61482f5f-b691-46fa-8359-334d2d3f8743 req-fee9a41b-91d1-450d-8abb-db615196024b service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received unexpected event network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 for instance with vm_state active and task_state None.
Nov 16 01:11:22 user nova-compute[75826]: INFO nova.compute.manager [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Took 5.90 seconds to build instance.
Nov 16 01:11:22 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-7007a4ff-8e8c-4733-a09a-d0e40b253137 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.996s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:11:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-47b3f87f-a50a-4f16-9a26-a0b54036e452" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-47b3f87f-a50a-4f16-9a26-a0b54036e452" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG nova.objects.instance [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lazy-loading 'info_cache' on Instance uuid 47b3f87f-a50a-4f16-9a26-a0b54036e452 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Updating instance_info_cache with network_info: [{"id": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "address": "fa:16:3e:92:81:c0", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5714dad-6a", "ovs_interfaceid": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-47b3f87f-a50a-4f16-9a26-a0b54036e452" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:11:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:11:26 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:11:26 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:11:26 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9118MB free_disk=25.261947631835938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:11:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:11:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:11:26 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 47b3f87f-a50a-4f16-9a26-a0b54036e452 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:11:26 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:11:26 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:11:26 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:11:26 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:11:26 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:11:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.196s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:11:28 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:11:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:11:32 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:11:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:11:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:11:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:11:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:11:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:35 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:11:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:11:37 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:11:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:11:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:11:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:11:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:11:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:39 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:11:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:11:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:12:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:12:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:12:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:12:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:12:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:12:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:12:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:12:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:12:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:12:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:12:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:12:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:12:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:12:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:12:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:12:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:12:26 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:12:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:12:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:12:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-47b3f87f-a50a-4f16-9a26-a0b54036e452" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:12:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-47b3f87f-a50a-4f16-9a26-a0b54036e452" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:12:26 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:12:26 user nova-compute[75826]: DEBUG nova.objects.instance [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lazy-loading 'info_cache' on Instance uuid 47b3f87f-a50a-4f16-9a26-a0b54036e452 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:12:26 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Updating instance_info_cache with network_info: [{"id": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "address": "fa:16:3e:92:81:c0", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5714dad-6a", "ovs_interfaceid": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:12:26 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-47b3f87f-a50a-4f16-9a26-a0b54036e452" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:12:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:12:26 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:12:27 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:12:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:12:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:12:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:12:27 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:12:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:12:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:12:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:12:27 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:12:27 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:12:27 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:12:27 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9039MB free_disk=25.233585357666016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:12:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:12:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:12:27 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 47b3f87f-a50a-4f16-9a26-a0b54036e452 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:12:27 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:12:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:12:28 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:12:28 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:12:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:12:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:12:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:12:29 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:12:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:12:32 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:12:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:12:37 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:12:37 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:12:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:12:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:12:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:12:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:12:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:12:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:12:39 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:12:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:12:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:12:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:12:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:12:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:12:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:12:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:12:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:12:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:12:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:12:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:12:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:12:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:12:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "47b3f87f-a50a-4f16-9a26-a0b54036e452" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:13:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:13:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:13:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:13:06 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:13:06 user nova-compute[75826]: INFO nova.compute.manager [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Terminating instance
Nov 16 01:13:06 user nova-compute[75826]: DEBUG nova.compute.manager [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:13:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG nova.compute.manager [req-a20b805e-9efc-40fa-81aa-3d3bad5e397b req-254b2a34-396b-4228-b9c7-dfec1aa850e6 service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received event network-vif-unplugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a20b805e-9efc-40fa-81aa-3d3bad5e397b req-254b2a34-396b-4228-b9c7-dfec1aa850e6 service nova] Acquiring lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a20b805e-9efc-40fa-81aa-3d3bad5e397b req-254b2a34-396b-4228-b9c7-dfec1aa850e6 service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a20b805e-9efc-40fa-81aa-3d3bad5e397b req-254b2a34-396b-4228-b9c7-dfec1aa850e6 service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG nova.compute.manager [req-a20b805e-9efc-40fa-81aa-3d3bad5e397b req-254b2a34-396b-4228-b9c7-dfec1aa850e6 service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] No waiting events found dispatching network-vif-unplugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG nova.compute.manager [req-a20b805e-9efc-40fa-81aa-3d3bad5e397b req-254b2a34-396b-4228-b9c7-dfec1aa850e6 service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received event network-vif-unplugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:07 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Instance destroyed successfully.
Nov 16 01:13:07 user nova-compute[75826]: DEBUG nova.objects.instance [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lazy-loading 'resources' on Instance uuid 47b3f87f-a50a-4f16-9a26-a0b54036e452 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:11:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1856849485',display_name='tempest-VolumesActionsTest-instance-1856849485',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1856849485',id=50,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:11:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cb81f5329aa3403abb08e33e6a75b210',ramdisk_id='',reservation_id='r-yb4kyz30',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-687556528',owner_user_name='tempest-VolumesActionsTest-687556528-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:11:22Z,user_data=None,user_id='9a11fec083364dd492810f1e98506603',uuid=47b3f87f-a50a-4f16-9a26-a0b54036e452,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "address": "fa:16:3e:92:81:c0", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5714dad-6a", "ovs_interfaceid": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Converting VIF {"id": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "address": "fa:16:3e:92:81:c0", "network": {"id": "f1b45630-a024-419f-aa33-6328416a460e", "bridge": "br-int", "label": "tempest-VolumesActionsTest-471822734-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cb81f5329aa3403abb08e33e6a75b210", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5714dad-6a", "ovs_interfaceid": "f5714dad-6a80-4528-baca-ea4af61fc9f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:81:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5714dad-6a80-4528-baca-ea4af61fc9f4,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5714dad-6a') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG os_vif [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:81:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5714dad-6a80-4528-baca-ea4af61fc9f4,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5714dad-6a') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5714dad-6a, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea5f988a-4fbb-4c2a-a5ab-c7b1eff2a347) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:13:07 user nova-compute[75826]: INFO os_vif [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:81:c0,bridge_name='br-int',has_traffic_filtering=True,id=f5714dad-6a80-4528-baca-ea4af61fc9f4,network=Network(f1b45630-a024-419f-aa33-6328416a460e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5714dad-6a')
Nov 16 01:13:07 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Deleting instance files /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452_del
Nov 16 01:13:07 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Deletion of /opt/stack/data/nova/instances/47b3f87f-a50a-4f16-9a26-a0b54036e452_del complete
Nov 16 01:13:07 user nova-compute[75826]: INFO nova.compute.manager [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 16 01:13:07 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:13:07 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:13:08 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:13:08 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Took 0.42 seconds to deallocate network for instance.
Nov 16 01:13:08 user nova-compute[75826]: DEBUG nova.compute.manager [req-d97d4dd8-2537-411f-a8eb-71e684a38f82 req-c2c152ce-1275-40cb-9eb3-e745f6cf1070 service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received event network-vif-deleted-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:13:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:13:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:13:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:08 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:13:08 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:13:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:13:08 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Deleted allocations for instance 47b3f87f-a50a-4f16-9a26-a0b54036e452
Nov 16 01:13:08 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-d29f69ce-a2af-43e3-bd20-6bf58df3af51 tempest-VolumesActionsTest-687556528 tempest-VolumesActionsTest-687556528-project-member] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.599s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received event network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] Acquiring lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] No waiting events found dispatching network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:13:09 user nova-compute[75826]: WARNING nova.compute.manager [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received unexpected event network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 for instance with vm_state deleted and task_state None.
Nov 16 01:13:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received event network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] Acquiring lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] No waiting events found dispatching network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:13:09 user nova-compute[75826]: WARNING nova.compute.manager [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received unexpected event network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 for instance with vm_state deleted and task_state None.
Nov 16 01:13:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received event network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] Acquiring lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] No waiting events found dispatching network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:13:09 user nova-compute[75826]: WARNING nova.compute.manager [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received unexpected event network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 for instance with vm_state deleted and task_state None.
Nov 16 01:13:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received event network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] Acquiring lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] Lock "47b3f87f-a50a-4f16-9a26-a0b54036e452-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:13:09 user nova-compute[75826]: DEBUG nova.compute.manager [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] No waiting events found dispatching network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:13:09 user nova-compute[75826]: WARNING nova.compute.manager [req-05a5e622-fe1c-4430-af8d-f2ac968f7aa0 req-4073c73e-9e66-4fc9-9576-ab2ded51afbe service nova] [instance: 47b3f87f-a50a-4f16-9a26-a0b54036e452] Received unexpected event network-vif-plugged-f5714dad-6a80-4528-baca-ea4af61fc9f4 for instance with vm_state deleted and task_state None.
Nov 16 01:13:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:13:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:13:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:13:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:13:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:13:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:13:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:13:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:13:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:13:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:13:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:26 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:13:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:13:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:13:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:13:27 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:13:27 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:13:27 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9190MB free_disk=25.252891540527344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:13:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:13:28 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:13:32 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:13:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:13:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:13:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:13:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:13:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:13:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:34 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:13:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:39 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:13:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:13:40 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:13:41 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:13:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:13:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:13:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:13:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:13:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:13:47 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:52 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:13:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:13:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:13:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:13:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:13:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:13:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:02 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:14:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:14:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:14:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:14:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:14:07 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:12 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:14:17 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:14:21 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:14:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:14:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:14:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:14:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:14:22 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:26 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:14:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:14:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:14:26 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 01:14:27 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:14:28 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:14:28 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:14:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9169MB free_disk=25.251827239990234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:14:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:14:29 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:14:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:32 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:14:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:36 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:14:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:14:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:14:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:14:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:14:37 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Acquiring lock "706960ac-1086-4e78-877c-0c66b6c14c62" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:14:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "706960ac-1086-4e78-877c-0c66b6c14c62" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.006s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:14:38 user nova-compute[75826]: DEBUG nova.compute.manager [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 01:14:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:14:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:14:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 01:14:38 user nova-compute[75826]: INFO nova.compute.claims [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Claim successful on node user
Nov 16 01:14:38 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 01:14:39 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 01:14:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG nova.policy [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2d130630cdeb4a13b2a4c587ec5693e1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed6d0231fabc436686d1220860217bfc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 01:14:39 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Creating image(s)
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Acquiring lock "/opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "/opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "/opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.191s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Acquiring lock "0bd4cef8411855e16e5840dd541706c1b38c004e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.167s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk 1073741824 {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e,backing_fmt=raw /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk 1073741824" returned: 0 in 0.049s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "0bd4cef8411855e16e5840dd541706c1b38c004e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Successfully created port: afd6e2d3-087f-48e7-96a4-e5520937616f {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e --force-share --output=json" returned: 0 in 0.180s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk. size=1073741824 {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 16 01:14:39 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.disk.api [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Cannot resize image /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk to a smaller size. {{(pid=75826) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Created local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Ensure instance console log exists: /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.network.neutron [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Successfully updated port: afd6e2d3-087f-48e7-96a4-e5520937616f {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Acquiring lock "refresh_cache-706960ac-1086-4e78-877c-0c66b6c14c62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Acquired lock "refresh_cache-706960ac-1086-4e78-877c-0c66b6c14c62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.network.neutron [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-325d96d1-bbaa-4b40-a33a-b16cbb9e496a req-e253e265-3dcd-4641-baf7-10deb2e16cd0 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Received event network-changed-afd6e2d3-087f-48e7-96a4-e5520937616f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.compute.manager [req-325d96d1-bbaa-4b40-a33a-b16cbb9e496a req-e253e265-3dcd-4641-baf7-10deb2e16cd0 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Refreshing instance network info cache due to event network-changed-afd6e2d3-087f-48e7-96a4-e5520937616f. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-325d96d1-bbaa-4b40-a33a-b16cbb9e496a req-e253e265-3dcd-4641-baf7-10deb2e16cd0 service nova] Acquiring lock "refresh_cache-706960ac-1086-4e78-877c-0c66b6c14c62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.network.neutron [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.network.neutron [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Updating instance_info_cache with network_info: [{"id": "afd6e2d3-087f-48e7-96a4-e5520937616f", "address": "fa:16:3e:c5:30:b5", "network": {"id": "faf33958-0711-44df-9641-691c3f6521e3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6c41ba5f2f547dd8ae30b9b4a163c72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd6e2d3-08", "ovs_interfaceid": "afd6e2d3-087f-48e7-96a4-e5520937616f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Releasing lock "refresh_cache-706960ac-1086-4e78-877c-0c66b6c14c62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.compute.manager [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Instance network_info: |[{"id": "afd6e2d3-087f-48e7-96a4-e5520937616f", "address": "fa:16:3e:c5:30:b5", "network": {"id": "faf33958-0711-44df-9641-691c3f6521e3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6c41ba5f2f547dd8ae30b9b4a163c72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd6e2d3-08", "ovs_interfaceid": "afd6e2d3-087f-48e7-96a4-e5520937616f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-325d96d1-bbaa-4b40-a33a-b16cbb9e496a req-e253e265-3dcd-4641-baf7-10deb2e16cd0 service nova] Acquired lock "refresh_cache-706960ac-1086-4e78-877c-0c66b6c14c62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.network.neutron [req-325d96d1-bbaa-4b40-a33a-b16cbb9e496a req-e253e265-3dcd-4641-baf7-10deb2e16cd0 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Refreshing network info cache for port afd6e2d3-087f-48e7-96a4-e5520937616f {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Start _get_guest_xml network_info=[{"id": "afd6e2d3-087f-48e7-96a4-e5520937616f", "address": "fa:16:3e:c5:30:b5", "network": {"id": "faf33958-0711-44df-9641-691c3f6521e3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6c41ba5f2f547dd8ae30b9b4a163c72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd6e2d3-08", "ovs_interfaceid": "afd6e2d3-087f-48e7-96a4-e5520937616f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_format': None, 'encrypted': False, 'size': 0, 'disk_bus': 'virtio', 'boot_index': 0, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'device_type': 'disk', 'guest_format': None, 'encryption_options': None, 'image_id': '61385222-0f31-4bd2-a3f7-ab482e7050c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 01:14:40 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:14:40 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-16T00:35:20Z,direct_url=<?>,disk_format='qcow2',id=61385222-0f31-4bd2-a3f7-ab482e7050c4,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='a6c41ba5f2f547dd8ae30b9b4a163c72',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-16T00:35:22Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-908427423',display_name='tempest-VolumesNegativeTest-instance-908427423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-908427423',id=51,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed6d0231fabc436686d1220860217bfc',ramdisk_id='',reservation_id='r-0jz1a64p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-126144155',owner_user_name='tempest-VolumesNegativeTest-126144155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:14:39Z,user_data=None,user_id='2d130630cdeb4a13b2a4c587ec5693e1',uuid=706960ac-1086-4e78-877c-0c66b6c14c62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afd6e2d3-087f-48e7-96a4-e5520937616f", "address": "fa:16:3e:c5:30:b5", "network": {"id": "faf33958-0711-44df-9641-691c3f6521e3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6c41ba5f2f547dd8ae30b9b4a163c72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd6e2d3-08", "ovs_interfaceid": "afd6e2d3-087f-48e7-96a4-e5520937616f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Converting VIF {"id": "afd6e2d3-087f-48e7-96a4-e5520937616f", "address": "fa:16:3e:c5:30:b5", "network": {"id": "faf33958-0711-44df-9641-691c3f6521e3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6c41ba5f2f547dd8ae30b9b4a163c72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd6e2d3-08", "ovs_interfaceid": "afd6e2d3-087f-48e7-96a4-e5520937616f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:30:b5,bridge_name='br-int',has_traffic_filtering=True,id=afd6e2d3-087f-48e7-96a4-e5520937616f,network=Network(faf33958-0711-44df-9641-691c3f6521e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd6e2d3-08') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.objects.instance [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lazy-loading 'pci_devices' on Instance uuid 706960ac-1086-4e78-877c-0c66b6c14c62 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] End _get_guest_xml xml=<domain type="kvm">
Nov 16 01:14:40 user nova-compute[75826]:   <uuid>706960ac-1086-4e78-877c-0c66b6c14c62</uuid>
Nov 16 01:14:40 user nova-compute[75826]:   <name>instance-00000033</name>
Nov 16 01:14:40 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 01:14:40 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 01:14:40 user nova-compute[75826]:   <metadata>
Nov 16 01:14:40 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 01:14:40 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 01:14:40 user nova-compute[75826]:       <nova:name>tempest-VolumesNegativeTest-instance-908427423</nova:name>
Nov 16 01:14:40 user nova-compute[75826]:       <nova:creationTime>2023-11-16 01:14:40</nova:creationTime>
Nov 16 01:14:40 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 01:14:40 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 01:14:40 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 01:14:40 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 01:14:40 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 01:14:40 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 01:14:40 user nova-compute[75826]:       </nova:flavor>
Nov 16 01:14:40 user nova-compute[75826]:       <nova:owner>
Nov 16 01:14:40 user nova-compute[75826]:         <nova:user uuid="2d130630cdeb4a13b2a4c587ec5693e1">tempest-VolumesNegativeTest-126144155-project-member</nova:user>
Nov 16 01:14:40 user nova-compute[75826]:         <nova:project uuid="ed6d0231fabc436686d1220860217bfc">tempest-VolumesNegativeTest-126144155</nova:project>
Nov 16 01:14:40 user nova-compute[75826]:       </nova:owner>
Nov 16 01:14:40 user nova-compute[75826]:       <nova:root type="image" uuid="61385222-0f31-4bd2-a3f7-ab482e7050c4"/>
Nov 16 01:14:40 user nova-compute[75826]:       <nova:ports>
Nov 16 01:14:40 user nova-compute[75826]:         <nova:port uuid="afd6e2d3-087f-48e7-96a4-e5520937616f">
Nov 16 01:14:40 user nova-compute[75826]:           <nova:ip type="fixed" address="192.168.233.138" ipVersion="4"/>
Nov 16 01:14:40 user nova-compute[75826]:         </nova:port>
Nov 16 01:14:40 user nova-compute[75826]:       </nova:ports>
Nov 16 01:14:40 user nova-compute[75826]:     </nova:instance>
Nov 16 01:14:40 user nova-compute[75826]:   </metadata>
Nov 16 01:14:40 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 01:14:40 user nova-compute[75826]:     <system>
Nov 16 01:14:40 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 01:14:40 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 01:14:40 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 01:14:40 user nova-compute[75826]:       <entry name="serial">706960ac-1086-4e78-877c-0c66b6c14c62</entry>
Nov 16 01:14:40 user nova-compute[75826]:       <entry name="uuid">706960ac-1086-4e78-877c-0c66b6c14c62</entry>
Nov 16 01:14:40 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 01:14:40 user nova-compute[75826]:     </system>
Nov 16 01:14:40 user nova-compute[75826]:   </sysinfo>
Nov 16 01:14:40 user nova-compute[75826]:   <os>
Nov 16 01:14:40 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 01:14:40 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 01:14:40 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 01:14:40 user nova-compute[75826]:   </os>
Nov 16 01:14:40 user nova-compute[75826]:   <features>
Nov 16 01:14:40 user nova-compute[75826]:     <acpi/>
Nov 16 01:14:40 user nova-compute[75826]:     <apic/>
Nov 16 01:14:40 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 01:14:40 user nova-compute[75826]:   </features>
Nov 16 01:14:40 user nova-compute[75826]:   <clock offset="utc">
Nov 16 01:14:40 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 01:14:40 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 01:14:40 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 01:14:40 user nova-compute[75826]:   </clock>
Nov 16 01:14:40 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 01:14:40 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 01:14:40 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 01:14:40 user nova-compute[75826]:   </cpu>
Nov 16 01:14:40 user nova-compute[75826]:   <devices>
Nov 16 01:14:40 user nova-compute[75826]:     <disk type="file" device="disk">
Nov 16 01:14:40 user nova-compute[75826]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 16 01:14:40 user nova-compute[75826]:       <source file="/opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk"/>
Nov 16 01:14:40 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 01:14:40 user nova-compute[75826]:     </disk>
Nov 16 01:14:40 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 01:14:40 user nova-compute[75826]:       <mac address="fa:16:3e:c5:30:b5"/>
Nov 16 01:14:40 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:14:40 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 01:14:40 user nova-compute[75826]:       <target dev="tapafd6e2d3-08"/>
Nov 16 01:14:40 user nova-compute[75826]:     </interface>
Nov 16 01:14:40 user nova-compute[75826]:     <serial type="pty">
Nov 16 01:14:40 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/console.log" append="off"/>
Nov 16 01:14:40 user nova-compute[75826]:     </serial>
Nov 16 01:14:40 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 01:14:40 user nova-compute[75826]:     <video>
Nov 16 01:14:40 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:14:40 user nova-compute[75826]:     </video>
Nov 16 01:14:40 user nova-compute[75826]:     <rng model="virtio">
Nov 16 01:14:40 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 01:14:40 user nova-compute[75826]:     </rng>
Nov 16 01:14:40 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 01:14:40 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 01:14:40 user nova-compute[75826]:       <stats period="10"/>
Nov 16 01:14:40 user nova-compute[75826]:     </memballoon>
Nov 16 01:14:40 user nova-compute[75826]:   </devices>
Nov 16 01:14:40 user nova-compute[75826]: </domain>
Nov 16 01:14:40 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-908427423',display_name='tempest-VolumesNegativeTest-instance-908427423',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-908427423',id=51,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed6d0231fabc436686d1220860217bfc',ramdisk_id='',reservation_id='r-0jz1a64p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-126144155',owner_user_name='tempest-VolumesNegativeTest-126144155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:14:39Z,user_data=None,user_id='2d130630cdeb4a13b2a4c587ec5693e1',uuid=706960ac-1086-4e78-877c-0c66b6c14c62,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "afd6e2d3-087f-48e7-96a4-e5520937616f", "address": "fa:16:3e:c5:30:b5", "network": {"id": "faf33958-0711-44df-9641-691c3f6521e3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6c41ba5f2f547dd8ae30b9b4a163c72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd6e2d3-08", "ovs_interfaceid": "afd6e2d3-087f-48e7-96a4-e5520937616f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Converting VIF {"id": "afd6e2d3-087f-48e7-96a4-e5520937616f", "address": "fa:16:3e:c5:30:b5", "network": {"id": "faf33958-0711-44df-9641-691c3f6521e3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6c41ba5f2f547dd8ae30b9b4a163c72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd6e2d3-08", "ovs_interfaceid": "afd6e2d3-087f-48e7-96a4-e5520937616f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:30:b5,bridge_name='br-int',has_traffic_filtering=True,id=afd6e2d3-087f-48e7-96a4-e5520937616f,network=Network(faf33958-0711-44df-9641-691c3f6521e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd6e2d3-08') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG os_vif [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:30:b5,bridge_name='br-int',has_traffic_filtering=True,id=afd6e2d3-087f-48e7-96a4-e5520937616f,network=Network(faf33958-0711-44df-9641-691c3f6521e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd6e2d3-08') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39e55d28-7f8b-5297-8dd3-0247efc91e74', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapafd6e2d3-08, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapafd6e2d3-08, col_values=(('qos', UUID('db809615-ae58-4a18-9051-42a98740f9ab')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapafd6e2d3-08, col_values=(('external_ids', {'iface-id': 'afd6e2d3-087f-48e7-96a4-e5520937616f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:30:b5', 'vm-uuid': '706960ac-1086-4e78-877c-0c66b6c14c62'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:40 user nova-compute[75826]: INFO os_vif [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:30:b5,bridge_name='br-int',has_traffic_filtering=True,id=afd6e2d3-087f-48e7-96a4-e5520937616f,network=Network(faf33958-0711-44df-9641-691c3f6521e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd6e2d3-08')
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:14:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] No VIF found with MAC fa:16:3e:c5:30:b5, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:14:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-325d96d1-bbaa-4b40-a33a-b16cbb9e496a req-e253e265-3dcd-4641-baf7-10deb2e16cd0 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Updated VIF entry in instance network info cache for port afd6e2d3-087f-48e7-96a4-e5520937616f. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:14:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-325d96d1-bbaa-4b40-a33a-b16cbb9e496a req-e253e265-3dcd-4641-baf7-10deb2e16cd0 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Updating instance_info_cache with network_info: [{"id": "afd6e2d3-087f-48e7-96a4-e5520937616f", "address": "fa:16:3e:c5:30:b5", "network": {"id": "faf33958-0711-44df-9641-691c3f6521e3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6c41ba5f2f547dd8ae30b9b4a163c72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd6e2d3-08", "ovs_interfaceid": "afd6e2d3-087f-48e7-96a4-e5520937616f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:14:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-325d96d1-bbaa-4b40-a33a-b16cbb9e496a req-e253e265-3dcd-4641-baf7-10deb2e16cd0 service nova] Releasing lock "refresh_cache-706960ac-1086-4e78-877c-0c66b6c14c62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:14:42 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:14:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-4d8bcb72-695c-4d2e-9c1d-34622ee9faa6 req-0e429954-d42a-4b97-ac5c-0428ead18597 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Received event network-vif-plugged-afd6e2d3-087f-48e7-96a4-e5520937616f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:14:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4d8bcb72-695c-4d2e-9c1d-34622ee9faa6 req-0e429954-d42a-4b97-ac5c-0428ead18597 service nova] Acquiring lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:14:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4d8bcb72-695c-4d2e-9c1d-34622ee9faa6 req-0e429954-d42a-4b97-ac5c-0428ead18597 service nova] Lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:14:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-4d8bcb72-695c-4d2e-9c1d-34622ee9faa6 req-0e429954-d42a-4b97-ac5c-0428ead18597 service nova] Lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:14:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-4d8bcb72-695c-4d2e-9c1d-34622ee9faa6 req-0e429954-d42a-4b97-ac5c-0428ead18597 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] No waiting events found dispatching network-vif-plugged-afd6e2d3-087f-48e7-96a4-e5520937616f {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:14:42 user nova-compute[75826]: WARNING nova.compute.manager [req-4d8bcb72-695c-4d2e-9c1d-34622ee9faa6 req-0e429954-d42a-4b97-ac5c-0428ead18597 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Received unexpected event network-vif-plugged-afd6e2d3-087f-48e7-96a4-e5520937616f for instance with vm_state building and task_state spawning.
Nov 16 01:14:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 01:14:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 01:14:44 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Instance spawned successfully.
Nov 16 01:14:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 01:14:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:14:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:14:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:14:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:14:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:14:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:14:44 user nova-compute[75826]: INFO nova.compute.manager [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 16 01:14:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:14:44 user nova-compute[75826]: INFO nova.compute.manager [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Took 5.72 seconds to build instance.
Nov 16 01:14:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-15e22436-5a53-4ca9-8b05-b6f8fa2ad6e4 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "706960ac-1086-4e78-877c-0c66b6c14c62" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.832s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:14:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-2e71e95a-633a-46db-9577-7d9adfc58b0f req-f7d654c7-2237-4f1e-b30f-95b1b73aa647 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Received event network-vif-plugged-afd6e2d3-087f-48e7-96a4-e5520937616f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:14:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2e71e95a-633a-46db-9577-7d9adfc58b0f req-f7d654c7-2237-4f1e-b30f-95b1b73aa647 service nova] Acquiring lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:14:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2e71e95a-633a-46db-9577-7d9adfc58b0f req-f7d654c7-2237-4f1e-b30f-95b1b73aa647 service nova] Lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:14:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2e71e95a-633a-46db-9577-7d9adfc58b0f req-f7d654c7-2237-4f1e-b30f-95b1b73aa647 service nova] Lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:14:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-2e71e95a-633a-46db-9577-7d9adfc58b0f req-f7d654c7-2237-4f1e-b30f-95b1b73aa647 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] No waiting events found dispatching network-vif-plugged-afd6e2d3-087f-48e7-96a4-e5520937616f {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:14:44 user nova-compute[75826]: WARNING nova.compute.manager [req-2e71e95a-633a-46db-9577-7d9adfc58b0f req-f7d654c7-2237-4f1e-b30f-95b1b73aa647 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Received unexpected event network-vif-plugged-afd6e2d3-087f-48e7-96a4-e5520937616f for instance with vm_state active and task_state None.
Nov 16 01:14:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Verify base images {{(pid=75826) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Image id 61385222-0f31-4bd2-a3f7-ab482e7050c4 yields fingerprint 0bd4cef8411855e16e5840dd541706c1b38c004e {{(pid=75826) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 16 01:14:52 user nova-compute[75826]: INFO nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] image 61385222-0f31-4bd2-a3f7-ab482e7050c4 at (/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e): checking
Nov 16 01:14:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] image 61385222-0f31-4bd2-a3f7-ab482e7050c4 at (/opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e): image is in use {{(pid=75826) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75826) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] 706960ac-1086-4e78-877c-0c66b6c14c62 is a valid instance name {{(pid=75826) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] 706960ac-1086-4e78-877c-0c66b6c14c62 has a disk file {{(pid=75826) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 706960ac-1086-4e78-877c-0c66b6c14c62 is backed by 0bd4cef8411855e16e5840dd541706c1b38c004e {{(pid=75826) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 16 01:14:52 user nova-compute[75826]: WARNING nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25
Nov 16 01:14:52 user nova-compute[75826]: WARNING nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591
Nov 16 01:14:52 user nova-compute[75826]: WARNING nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9
Nov 16 01:14:52 user nova-compute[75826]: WARNING nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885
Nov 16 01:14:52 user nova-compute[75826]: WARNING nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e
Nov 16 01:14:52 user nova-compute[75826]: WARNING nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992
Nov 16 01:14:52 user nova-compute[75826]: WARNING nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a
Nov 16 01:14:52 user nova-compute[75826]: WARNING nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e
Nov 16 01:14:52 user nova-compute[75826]: WARNING nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Unknown base file: /opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748
Nov 16 01:14:52 user nova-compute[75826]: INFO nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Active base files: /opt/stack/data/nova/instances/_base/0bd4cef8411855e16e5840dd541706c1b38c004e
Nov 16 01:14:52 user nova-compute[75826]: INFO nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Removable base files: /opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25 /opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591 /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9 /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885 /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992 /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e /opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748
Nov 16 01:14:52 user nova-compute[75826]: INFO nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/da8fefc2106233aee4dbd15a93c8207cd1878c25
Nov 16 01:14:52 user nova-compute[75826]: INFO nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8ff4a7016e90f2363fe56df747712b57d9c54591
Nov 16 01:14:52 user nova-compute[75826]: INFO nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/db05b037fd11181b9c08ff338a02636988b7c7b9
Nov 16 01:14:52 user nova-compute[75826]: INFO nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/467a67a710dbb1a1a2e761dfdce39019c0fe8885
Nov 16 01:14:52 user nova-compute[75826]: INFO nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2ee06023589a2aa06ee408db6cde79be075deb9e
Nov 16 01:14:52 user nova-compute[75826]: INFO nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b94fa784a58e64fc12d686ae0b100f6252ae9992
Nov 16 01:14:52 user nova-compute[75826]: INFO nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/18dc6c0fff74d2d8a20d4c0becd2dad7fb83999a
Nov 16 01:14:52 user nova-compute[75826]: INFO nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/657a7197914ff57b393e1654d4a9a9cba35cfd8e
Nov 16 01:14:52 user nova-compute[75826]: INFO nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/765d84e26d01a08dffe0be3b4e8ae6347300f748
Nov 16 01:14:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Verification complete {{(pid=75826) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Verify swap images {{(pid=75826) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 16 01:14:52 user nova-compute[75826]: DEBUG nova.virt.libvirt.imagecache [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Verify ephemeral images {{(pid=75826) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 16 01:14:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:15:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:22 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:15:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:27 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:15:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:15:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:15:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-706960ac-1086-4e78-877c-0c66b6c14c62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:15:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-706960ac-1086-4e78-877c-0c66b6c14c62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:15:27 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:15:27 user nova-compute[75826]: DEBUG nova.objects.instance [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lazy-loading 'info_cache' on Instance uuid 706960ac-1086-4e78-877c-0c66b6c14c62 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:15:27 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Updating instance_info_cache with network_info: [{"id": "afd6e2d3-087f-48e7-96a4-e5520937616f", "address": "fa:16:3e:c5:30:b5", "network": {"id": "faf33958-0711-44df-9641-691c3f6521e3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6c41ba5f2f547dd8ae30b9b4a163c72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd6e2d3-08", "ovs_interfaceid": "afd6e2d3-087f-48e7-96a4-e5520937616f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:15:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-706960ac-1086-4e78-877c-0c66b6c14c62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:15:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:15:28 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:15:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:15:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:15:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:15:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:15:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:15:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:15:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:15:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:15:28 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:15:28 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:15:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9053MB free_disk=25.221885681152344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:15:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:15:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:15:29 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 706960ac-1086-4e78-877c-0c66b6c14c62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:15:29 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:15:29 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:15:29 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing inventories for resource provider 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 01:15:29 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating ProviderTree inventory for provider 015246d3-5250-41ea-8943-b837ba3f5938 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 01:15:29 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating inventory in ProviderTree for provider 015246d3-5250-41ea-8943-b837ba3f5938 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 01:15:29 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing aggregate associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, aggregates: None {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 01:15:29 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing trait associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 01:15:29 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:15:29 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:15:29 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:15:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.432s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:15:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:15:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:15:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:15:33 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:15:33 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:15:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:15:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:15:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:15:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:15:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:15:38 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:15:39 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:15:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:15:39 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:15:39 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75826) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 01:15:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:41 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:15:41 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 01:15:41 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] There are 0 instances to clean {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 01:15:42 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:15:45 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:15:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:15:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:15:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:16:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:16:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:16:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:16:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:16:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:16:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:16:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:16:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:16:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:22 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:16:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:16:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:16:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:16:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:27 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:16:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:16:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:16:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-706960ac-1086-4e78-877c-0c66b6c14c62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:16:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-706960ac-1086-4e78-877c-0c66b6c14c62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:16:27 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:16:27 user nova-compute[75826]: DEBUG nova.objects.instance [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lazy-loading 'info_cache' on Instance uuid 706960ac-1086-4e78-877c-0c66b6c14c62 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:16:27 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Updating instance_info_cache with network_info: [{"id": "afd6e2d3-087f-48e7-96a4-e5520937616f", "address": "fa:16:3e:c5:30:b5", "network": {"id": "faf33958-0711-44df-9641-691c3f6521e3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6c41ba5f2f547dd8ae30b9b4a163c72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd6e2d3-08", "ovs_interfaceid": "afd6e2d3-087f-48e7-96a4-e5520937616f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:16:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-706960ac-1086-4e78-877c-0c66b6c14c62" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:16:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk --force-share --output=json {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:16:28 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:16:28 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:16:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9088MB free_disk=25.221332550048828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Acquiring lock "706960ac-1086-4e78-877c-0c66b6c14c62" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "706960ac-1086-4e78-877c-0c66b6c14c62" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Acquiring lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:16:28 user nova-compute[75826]: INFO nova.compute.manager [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Terminating instance
Nov 16 01:16:28 user nova-compute[75826]: DEBUG nova.compute.manager [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance 706960ac-1086-4e78-877c-0c66b6c14c62 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:16:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.211s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-052bc63d-6297-44bb-8b7f-3b28431c1070 req-31ea8615-66f3-4199-8344-06233e5977e8 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Received event network-vif-unplugged-afd6e2d3-087f-48e7-96a4-e5520937616f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-052bc63d-6297-44bb-8b7f-3b28431c1070 req-31ea8615-66f3-4199-8344-06233e5977e8 service nova] Acquiring lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-052bc63d-6297-44bb-8b7f-3b28431c1070 req-31ea8615-66f3-4199-8344-06233e5977e8 service nova] Lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-052bc63d-6297-44bb-8b7f-3b28431c1070 req-31ea8615-66f3-4199-8344-06233e5977e8 service nova] Lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-052bc63d-6297-44bb-8b7f-3b28431c1070 req-31ea8615-66f3-4199-8344-06233e5977e8 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] No waiting events found dispatching network-vif-unplugged-afd6e2d3-087f-48e7-96a4-e5520937616f {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG nova.compute.manager [req-052bc63d-6297-44bb-8b7f-3b28431c1070 req-31ea8615-66f3-4199-8344-06233e5977e8 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Received event network-vif-unplugged-afd6e2d3-087f-48e7-96a4-e5520937616f for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:29 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Instance destroyed successfully.
Nov 16 01:16:29 user nova-compute[75826]: DEBUG nova.objects.instance [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lazy-loading 'resources' on Instance uuid 706960ac-1086-4e78-877c-0c66b6c14c62 {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:14:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-908427423',display_name='tempest-VolumesNegativeTest-instance-908427423',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-908427423',id=51,image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:14:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ed6d0231fabc436686d1220860217bfc',ramdisk_id='',reservation_id='r-0jz1a64p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='61385222-0f31-4bd2-a3f7-ab482e7050c4',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-126144155',owner_user_name='tempest-VolumesNegativeTest-126144155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:14:44Z,user_data=None,user_id='2d130630cdeb4a13b2a4c587ec5693e1',uuid=706960ac-1086-4e78-877c-0c66b6c14c62,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "afd6e2d3-087f-48e7-96a4-e5520937616f", "address": "fa:16:3e:c5:30:b5", "network": {"id": "faf33958-0711-44df-9641-691c3f6521e3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6c41ba5f2f547dd8ae30b9b4a163c72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd6e2d3-08", "ovs_interfaceid": "afd6e2d3-087f-48e7-96a4-e5520937616f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Converting VIF {"id": "afd6e2d3-087f-48e7-96a4-e5520937616f", "address": "fa:16:3e:c5:30:b5", "network": {"id": "faf33958-0711-44df-9641-691c3f6521e3", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.138", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "a6c41ba5f2f547dd8ae30b9b4a163c72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapafd6e2d3-08", "ovs_interfaceid": "afd6e2d3-087f-48e7-96a4-e5520937616f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:30:b5,bridge_name='br-int',has_traffic_filtering=True,id=afd6e2d3-087f-48e7-96a4-e5520937616f,network=Network(faf33958-0711-44df-9641-691c3f6521e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd6e2d3-08') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG os_vif [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:30:b5,bridge_name='br-int',has_traffic_filtering=True,id=afd6e2d3-087f-48e7-96a4-e5520937616f,network=Network(faf33958-0711-44df-9641-691c3f6521e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd6e2d3-08') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapafd6e2d3-08, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db809615-ae58-4a18-9051-42a98740f9ab) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:29 user nova-compute[75826]: INFO os_vif [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:30:b5,bridge_name='br-int',has_traffic_filtering=True,id=afd6e2d3-087f-48e7-96a4-e5520937616f,network=Network(faf33958-0711-44df-9641-691c3f6521e3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapafd6e2d3-08')
Nov 16 01:16:29 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Deleting instance files /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62_del
Nov 16 01:16:29 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Deletion of /opt/stack/data/nova/instances/706960ac-1086-4e78-877c-0c66b6c14c62_del complete
Nov 16 01:16:29 user nova-compute[75826]: INFO nova.compute.manager [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 16 01:16:29 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:16:29 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:16:30 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:16:30 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Took 0.49 seconds to deallocate network for instance.
Nov 16 01:16:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:16:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:16:30 user nova-compute[75826]: DEBUG nova.compute.manager [req-8c739211-850f-4336-9e98-40053b8418fb req-fb68f1b4-bb08-4940-aa88-1794ebf3a5a8 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Received event network-vif-deleted-afd6e2d3-087f-48e7-96a4-e5520937616f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:16:30 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:16:30 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:16:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:16:30 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Deleted allocations for instance 706960ac-1086-4e78-877c-0c66b6c14c62
Nov 16 01:16:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-3f5f1bd0-83b9-4008-975b-a7f252acb127 tempest-VolumesNegativeTest-126144155 tempest-VolumesNegativeTest-126144155-project-member] Lock "706960ac-1086-4e78-877c-0c66b6c14c62" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.716s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:16:31 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:16:31 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:16:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-f4f947d9-309a-48e1-a4ff-ada140661605 req-6a4d6f96-49df-4201-89a9-d88e2554eb48 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Received event network-vif-plugged-afd6e2d3-087f-48e7-96a4-e5520937616f {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:16:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f4f947d9-309a-48e1-a4ff-ada140661605 req-6a4d6f96-49df-4201-89a9-d88e2554eb48 service nova] Acquiring lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:16:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f4f947d9-309a-48e1-a4ff-ada140661605 req-6a4d6f96-49df-4201-89a9-d88e2554eb48 service nova] Lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:16:31 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-f4f947d9-309a-48e1-a4ff-ada140661605 req-6a4d6f96-49df-4201-89a9-d88e2554eb48 service nova] Lock "706960ac-1086-4e78-877c-0c66b6c14c62-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:16:31 user nova-compute[75826]: DEBUG nova.compute.manager [req-f4f947d9-309a-48e1-a4ff-ada140661605 req-6a4d6f96-49df-4201-89a9-d88e2554eb48 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] No waiting events found dispatching network-vif-plugged-afd6e2d3-087f-48e7-96a4-e5520937616f {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:16:31 user nova-compute[75826]: WARNING nova.compute.manager [req-f4f947d9-309a-48e1-a4ff-ada140661605 req-6a4d6f96-49df-4201-89a9-d88e2554eb48 service nova] [instance: 706960ac-1086-4e78-877c-0c66b6c14c62] Received unexpected event network-vif-plugged-afd6e2d3-087f-48e7-96a4-e5520937616f for instance with vm_state deleted and task_state None.
Nov 16 01:16:33 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:16:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:38 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:16:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:41 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:16:41 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:16:43 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:16:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:16:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:16:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:16:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:16:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:16:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:16:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:16:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:16:59 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:17:01 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:17:04 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:17:09 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:17:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:17:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:17:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:17:14 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:19 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:22 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:17:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:17:27 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:17:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:17:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:17:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:17:28 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:17:28 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:17:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9213MB free_disk=25.248069763183594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:17:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:29 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:31 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:17:31 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:17:32 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:34 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:35 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:17:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:38 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:17:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:41 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:17:41 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:17:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:44 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:17:44 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:48 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:17:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "a7dcc94c-03b0-4074-8669-88953b80e50d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:17:48 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:17:48 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Starting instance... {{(pid=75826) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 01:17:49 user nova-compute[75826]: INFO nova.compute.claims [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Claim successful on node user
Nov 16 01:17:49 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.182s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Start building networks asynchronously for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Allocating IP information in the background. {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] allocate_for_instance() {{(pid=75826) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 16 01:17:49 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 16 01:17:49 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Start building block device mappings for instance. {{(pid=75826) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG nova.policy [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f1dcde0f72845ba8b644430536aa38b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2fb0835e39b64da1bfc6353477f59a69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75826) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 16 01:17:49 user nova-compute[75826]: INFO nova.virt.block_device [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Booting with volume 961da9ac-578a-4e39-ad0d-66c9b70cb532 at /dev/vda
Nov 16 01:17:49 user nova-compute[75826]: DEBUG os_brick.utils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[712800f6-bd92-4c53-96a0-8b9f44e61591]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[afaafa08-7d3c-40ee-8d37-dbb4265d0c00]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8895592-43f9-4596-90c2-c205073626d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c4add0-8f48-4962-bb03-228575cbbe42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:17:49 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 01:17:49 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e9f3c6-3972-437d-9c02-0b0e81354a2b]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG os_brick.utils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:17:49 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating existing volume attachment record: 6bd68afb-a404-4e0c-824e-f5a790a7707c {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 01:17:50 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Successfully created port: 354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 16 01:17:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:50 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Successfully updated port: 354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 16 01:17:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:17:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquired lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:17:50 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:17:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-c1b3ff6a-f3af-4f2d-a9b3-85d956d774ab req-1d6e2f54-1fd0-4455-a0d2-620140a4506f service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-changed-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:17:50 user nova-compute[75826]: DEBUG nova.compute.manager [req-c1b3ff6a-f3af-4f2d-a9b3-85d956d774ab req-1d6e2f54-1fd0-4455-a0d2-620140a4506f service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Refreshing instance network info cache due to event network-changed-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:17:50 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c1b3ff6a-f3af-4f2d-a9b3-85d956d774ab req-1d6e2f54-1fd0-4455-a0d2-620140a4506f service nova] Acquiring lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:17:50 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Instance cache missing network info. {{(pid=75826) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 16 01:17:51 user nova-compute[75826]: DEBUG nova.network.neutron [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating instance_info_cache with network_info: [{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:17:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Releasing lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:17:51 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Instance network_info: |[{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75826) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 16 01:17:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c1b3ff6a-f3af-4f2d-a9b3-85d956d774ab req-1d6e2f54-1fd0-4455-a0d2-620140a4506f service nova] Acquired lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:17:51 user nova-compute[75826]: DEBUG nova.network.neutron [req-c1b3ff6a-f3af-4f2d-a9b3-85d956d774ab req-1d6e2f54-1fd0-4455-a0d2-620140a4506f service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Refreshing network info cache for port 354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:17:51 user nova-compute[75826]: DEBUG nova.network.neutron [req-c1b3ff6a-f3af-4f2d-a9b3-85d956d774ab req-1d6e2f54-1fd0-4455-a0d2-620140a4506f service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updated VIF entry in instance network info cache for port 354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:17:51 user nova-compute[75826]: DEBUG nova.network.neutron [req-c1b3ff6a-f3af-4f2d-a9b3-85d956d774ab req-1d6e2f54-1fd0-4455-a0d2-620140a4506f service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating instance_info_cache with network_info: [{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:17:51 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c1b3ff6a-f3af-4f2d-a9b3-85d956d774ab req-1d6e2f54-1fd0-4455-a0d2-620140a4506f service nova] Releasing lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Start spawning the instance on the hypervisor. {{(pid=75826) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 01:17:54 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Creating image(s)
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Ensure instance console log exists: /opt/stack/data/nova/instances/a7dcc94c-03b0-4074-8669-88953b80e50d/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Start _get_guest_xml network_info=[{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6bd68afb-a404-4e0c-824e-f5a790a7707c', 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaWiAwLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a7dcc94c-03b0-4074-8669-88953b80e50d', 'attached_at': '', 'detached_at': '', 'volume_id': '961da9ac-578a-4e39-ad0d-66c9b70cb532', 'serial': '961da9ac-578a-4e39-ad0d-66c9b70cb532'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 01:17:54 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:17:54 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaWiAwLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:17:54 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:17:54 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:17:54 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7272c8d-1997-4b57-b38c-e36bafb759c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 01:17:54 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[61229503-4a9c-485b-a31a-b1dade9a8115]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532] added
Nov 16 01:17:54 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59a2571-e4bf-4bc8-80a9-08809d12c98f]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d146f73b-7685-403c-9221-d4876f727c87]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaWiAwLn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaWiAwLn" returned: 0 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fcbd9ae-a4d3-472a-abad-0bcb1c24ccfd]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SaWiAwLn'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5af5ee-0348-40ca-9cae-7fb8f617586b]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fa91af-88b1-43e9-b017-6a927af0a43e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 01:17:54 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 01:17:54 user nova-compute[75826]:  {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:17:54 user nova-compute[75826]: WARNING os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 01:17:54 user nova-compute[75826]: 
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a93e03-e62d-431f-9349-6db96eec364b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260]
Nov 16 01:17:54 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260] successful.
Nov 16 01:17:54 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64241b3-0429-4de9-84d5-45aaa0ac5103]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5767b27d-86f9-4506-9175-37b35834efea]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 (non-flash)
Nov 16 01:17:54 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 (non-flash)
Nov 16 01:17:54 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.249s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[36044dab-a9cc-44f8-88a5-f55def9d78d8]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:17:54 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaWiAwLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23935623538343032', 'path': '/dev/sdb'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935623538343032', 'path': '/dev/sdb'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-890730728',display_name='tempest-TestShelveInstance-server-890730728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-890730728',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi9PTpAve9X0akAiJ1yFYS8MQ+iSMEyi9FAphfu6ArF6suwIkhSt6eTp4fJ5l+C5sp8ujFVWVuN8DZ4vxzLULL589PtoVPsh+rwj3iyefiKc87zvtkftZ8ahQHEUijFgg==',key_name='tempest-TestShelveInstance-681347913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fb0835e39b64da1bfc6353477f59a69',ramdisk_id='',reservation_id='r-82j2k6z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1257684070',owner_user_name='tempest-TestShelveInstance-1257684070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:17:50Z,user_data=None,user_id='5f1dcde0f72845ba8b644430536aa38b',uuid=a7dcc94c-03b0-4074-8669-88953b80e50d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Converting VIF {"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG nova.objects.instance [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lazy-loading 'pci_devices' on Instance uuid a7dcc94c-03b0-4074-8669-88953b80e50d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 01:17:55 user nova-compute[75826]:   <uuid>a7dcc94c-03b0-4074-8669-88953b80e50d</uuid>
Nov 16 01:17:55 user nova-compute[75826]:   <name>instance-00000034</name>
Nov 16 01:17:55 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 01:17:55 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 01:17:55 user nova-compute[75826]:   <metadata>
Nov 16 01:17:55 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 01:17:55 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 01:17:55 user nova-compute[75826]:       <nova:name>tempest-TestShelveInstance-server-890730728</nova:name>
Nov 16 01:17:55 user nova-compute[75826]:       <nova:creationTime>2023-11-16 01:17:54</nova:creationTime>
Nov 16 01:17:55 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 01:17:55 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 01:17:55 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 01:17:55 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 01:17:55 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 01:17:55 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 01:17:55 user nova-compute[75826]:       </nova:flavor>
Nov 16 01:17:55 user nova-compute[75826]:       <nova:owner>
Nov 16 01:17:55 user nova-compute[75826]:         <nova:user uuid="5f1dcde0f72845ba8b644430536aa38b">tempest-TestShelveInstance-1257684070-project-member</nova:user>
Nov 16 01:17:55 user nova-compute[75826]:         <nova:project uuid="2fb0835e39b64da1bfc6353477f59a69">tempest-TestShelveInstance-1257684070</nova:project>
Nov 16 01:17:55 user nova-compute[75826]:       </nova:owner>
Nov 16 01:17:55 user nova-compute[75826]:       <nova:ports>
Nov 16 01:17:55 user nova-compute[75826]:         <nova:port uuid="354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc">
Nov 16 01:17:55 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 01:17:55 user nova-compute[75826]:         </nova:port>
Nov 16 01:17:55 user nova-compute[75826]:       </nova:ports>
Nov 16 01:17:55 user nova-compute[75826]:     </nova:instance>
Nov 16 01:17:55 user nova-compute[75826]:   </metadata>
Nov 16 01:17:55 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 01:17:55 user nova-compute[75826]:     <system>
Nov 16 01:17:55 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 01:17:55 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 01:17:55 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 01:17:55 user nova-compute[75826]:       <entry name="serial">a7dcc94c-03b0-4074-8669-88953b80e50d</entry>
Nov 16 01:17:55 user nova-compute[75826]:       <entry name="uuid">a7dcc94c-03b0-4074-8669-88953b80e50d</entry>
Nov 16 01:17:55 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 01:17:55 user nova-compute[75826]:     </system>
Nov 16 01:17:55 user nova-compute[75826]:   </sysinfo>
Nov 16 01:17:55 user nova-compute[75826]:   <os>
Nov 16 01:17:55 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 01:17:55 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 01:17:55 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 01:17:55 user nova-compute[75826]:   </os>
Nov 16 01:17:55 user nova-compute[75826]:   <features>
Nov 16 01:17:55 user nova-compute[75826]:     <acpi/>
Nov 16 01:17:55 user nova-compute[75826]:     <apic/>
Nov 16 01:17:55 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 01:17:55 user nova-compute[75826]:   </features>
Nov 16 01:17:55 user nova-compute[75826]:   <clock offset="utc">
Nov 16 01:17:55 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 01:17:55 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 01:17:55 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 01:17:55 user nova-compute[75826]:   </clock>
Nov 16 01:17:55 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 01:17:55 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 01:17:55 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 01:17:55 user nova-compute[75826]:   </cpu>
Nov 16 01:17:55 user nova-compute[75826]:   <devices>
Nov 16 01:17:55 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 01:17:55 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:17:55 user nova-compute[75826]:       <source dev="/dev/sdb"/>
Nov 16 01:17:55 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 01:17:55 user nova-compute[75826]:       <serial>961da9ac-578a-4e39-ad0d-66c9b70cb532</serial>
Nov 16 01:17:55 user nova-compute[75826]:     </disk>
Nov 16 01:17:55 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 01:17:55 user nova-compute[75826]:       <mac address="fa:16:3e:4c:c7:fc"/>
Nov 16 01:17:55 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:17:55 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 01:17:55 user nova-compute[75826]:       <target dev="tap354aaf2c-eb"/>
Nov 16 01:17:55 user nova-compute[75826]:     </interface>
Nov 16 01:17:55 user nova-compute[75826]:     <serial type="pty">
Nov 16 01:17:55 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/a7dcc94c-03b0-4074-8669-88953b80e50d/console.log" append="off"/>
Nov 16 01:17:55 user nova-compute[75826]:     </serial>
Nov 16 01:17:55 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 01:17:55 user nova-compute[75826]:     <video>
Nov 16 01:17:55 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:17:55 user nova-compute[75826]:     </video>
Nov 16 01:17:55 user nova-compute[75826]:     <rng model="virtio">
Nov 16 01:17:55 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 01:17:55 user nova-compute[75826]:     </rng>
Nov 16 01:17:55 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 01:17:55 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 01:17:55 user nova-compute[75826]:       <stats period="10"/>
Nov 16 01:17:55 user nova-compute[75826]:     </memballoon>
Nov 16 01:17:55 user nova-compute[75826]:   </devices>
Nov 16 01:17:55 user nova-compute[75826]: </domain>
Nov 16 01:17:55 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-890730728',display_name='tempest-TestShelveInstance-server-890730728',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-890730728',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi9PTpAve9X0akAiJ1yFYS8MQ+iSMEyi9FAphfu6ArF6suwIkhSt6eTp4fJ5l+C5sp8ujFVWVuN8DZ4vxzLULL589PtoVPsh+rwj3iyefiKc87zvtkftZ8ahQHEUijFgg==',key_name='tempest-TestShelveInstance-681347913',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2fb0835e39b64da1bfc6353477f59a69',ramdisk_id='',reservation_id='r-82j2k6z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1257684070',owner_user_name='tempest-TestShelveInstance-1257684070-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-16T01:17:50Z,user_data=None,user_id='5f1dcde0f72845ba8b644430536aa38b',uuid=a7dcc94c-03b0-4074-8669-88953b80e50d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Converting VIF {"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG os_vif [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1aa74301-936b-57ae-8c39-77a9ab2423d7', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap354aaf2c-eb, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap354aaf2c-eb, col_values=(('qos', UUID('b899780d-e1d1-4824-b719-50c98391e8ac')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap354aaf2c-eb, col_values=(('external_ids', {'iface-id': '354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:c7:fc', 'vm-uuid': 'a7dcc94c-03b0-4074-8669-88953b80e50d'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:17:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:55 user nova-compute[75826]: INFO os_vif [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb')
Nov 16 01:17:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:17:56 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] No VIF found with MAC fa:16:3e:4c:c7:fc, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:17:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-adc634ba-174c-4c0c-9137-a5d99310e760 req-27d0fb9b-43da-46ed-b2e5-c2e36ce3d665 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:17:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-adc634ba-174c-4c0c-9137-a5d99310e760 req-27d0fb9b-43da-46ed-b2e5-c2e36ce3d665 service nova] Acquiring lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:17:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-adc634ba-174c-4c0c-9137-a5d99310e760 req-27d0fb9b-43da-46ed-b2e5-c2e36ce3d665 service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:17:57 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-adc634ba-174c-4c0c-9137-a5d99310e760 req-27d0fb9b-43da-46ed-b2e5-c2e36ce3d665 service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:17:57 user nova-compute[75826]: DEBUG nova.compute.manager [req-adc634ba-174c-4c0c-9137-a5d99310e760 req-27d0fb9b-43da-46ed-b2e5-c2e36ce3d665 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] No waiting events found dispatching network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:17:57 user nova-compute[75826]: WARNING nova.compute.manager [req-adc634ba-174c-4c0c-9137-a5d99310e760 req-27d0fb9b-43da-46ed-b2e5-c2e36ce3d665 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received unexpected event network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc for instance with vm_state building and task_state spawning.
Nov 16 01:17:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:57 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:17:59 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 01:17:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 01:17:59 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Instance spawned successfully.
Nov 16 01:17:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 16 01:17:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Found default for hw_cdrom_bus of ide {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:17:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Found default for hw_disk_bus of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:17:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Found default for hw_input_bus of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:17:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Found default for hw_pointer_model of None {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:17:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Found default for hw_video_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:17:59 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Found default for hw_vif_model of virtio {{(pid=75826) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 16 01:17:59 user nova-compute[75826]: INFO nova.compute.manager [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Took 4.88 seconds to spawn the instance on the hypervisor.
Nov 16 01:17:59 user nova-compute[75826]: DEBUG nova.compute.manager [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:17:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-5b964e19-c559-4e92-89cb-b4170415c252 req-d0d42570-2e7f-4a90-96b8-15f96be09c55 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:17:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5b964e19-c559-4e92-89cb-b4170415c252 req-d0d42570-2e7f-4a90-96b8-15f96be09c55 service nova] Acquiring lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:17:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5b964e19-c559-4e92-89cb-b4170415c252 req-d0d42570-2e7f-4a90-96b8-15f96be09c55 service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:17:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-5b964e19-c559-4e92-89cb-b4170415c252 req-d0d42570-2e7f-4a90-96b8-15f96be09c55 service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:17:59 user nova-compute[75826]: DEBUG nova.compute.manager [req-5b964e19-c559-4e92-89cb-b4170415c252 req-d0d42570-2e7f-4a90-96b8-15f96be09c55 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] No waiting events found dispatching network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:17:59 user nova-compute[75826]: WARNING nova.compute.manager [req-5b964e19-c559-4e92-89cb-b4170415c252 req-d0d42570-2e7f-4a90-96b8-15f96be09c55 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received unexpected event network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc for instance with vm_state building and task_state spawning.
Nov 16 01:17:59 user nova-compute[75826]: INFO nova.compute.manager [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Took 10.30 seconds to build instance.
Nov 16 01:17:59 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-2b0aa3ef-40db-4f85-8b62-3a44bc1e7367 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.653s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:18:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:18:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:18:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:18:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:18:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:24 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:18:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:29 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:18:29 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:18:29 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:18:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:18:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:18:29 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:18:29 user nova-compute[75826]: DEBUG nova.objects.instance [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lazy-loading 'info_cache' on Instance uuid a7dcc94c-03b0-4074-8669-88953b80e50d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:18:29 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating instance_info_cache with network_info: [{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:18:29 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:18:29 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:18:30 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:18:30 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:18:30 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9017MB free_disk=25.245285034179688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance a7dcc94c-03b0-4074-8669-88953b80e50d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:18:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:32 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:18:32 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:18:35 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:18:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:18:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:18:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:18:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:18:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:39 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:18:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:18:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:18:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:18:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:18:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:42 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:18:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:18:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:46 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:18:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:18:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:18:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:18:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:18:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:18:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:19:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:19:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:19:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:19:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:19:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:19:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:19:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:19:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:19:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:19:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:19:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:19:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:25 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:19:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:19:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:19:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:19:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:19:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:19:30 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:19:30 user nova-compute[75826]: DEBUG nova.objects.instance [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lazy-loading 'info_cache' on Instance uuid a7dcc94c-03b0-4074-8669-88953b80e50d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:19:30 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating instance_info_cache with network_info: [{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:19:30 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:19:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:19:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:19:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:19:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:19:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:19:32 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:19:32 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:19:32 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9062MB free_disk=25.24469757080078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance a7dcc94c-03b0-4074-8669-88953b80e50d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:19:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.157s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:19:33 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:19:34 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:19:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:36 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:19:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:40 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-2122e95d-aa51-4a93-b3be-282eccd84ed7 req-b511a572-064a-40d4-be5d-8f002d9143bb service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-changed-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG nova.compute.manager [req-2122e95d-aa51-4a93-b3be-282eccd84ed7 req-b511a572-064a-40d4-be5d-8f002d9143bb service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Refreshing instance network info cache due to event network-changed-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2122e95d-aa51-4a93-b3be-282eccd84ed7 req-b511a572-064a-40d4-be5d-8f002d9143bb service nova] Acquiring lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2122e95d-aa51-4a93-b3be-282eccd84ed7 req-b511a572-064a-40d4-be5d-8f002d9143bb service nova] Acquired lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-2122e95d-aa51-4a93-b3be-282eccd84ed7 req-b511a572-064a-40d4-be5d-8f002d9143bb service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Refreshing network info cache for port 354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-2122e95d-aa51-4a93-b3be-282eccd84ed7 req-b511a572-064a-40d4-be5d-8f002d9143bb service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updated VIF entry in instance network info cache for port 354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG nova.network.neutron [req-2122e95d-aa51-4a93-b3be-282eccd84ed7 req-b511a572-064a-40d4-be5d-8f002d9143bb service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating instance_info_cache with network_info: [{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-2122e95d-aa51-4a93-b3be-282eccd84ed7 req-b511a572-064a-40d4-be5d-8f002d9143bb service nova] Releasing lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "a7dcc94c-03b0-4074-8669-88953b80e50d" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:19:41 user nova-compute[75826]: INFO nova.compute.manager [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Shelve offloading
Nov 16 01:19:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-a9ee5ba0-7063-4442-88b8-3ec829613adf req-da2b15ed-b430-465f-bd01-e419bc78d584 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-vif-unplugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:19:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a9ee5ba0-7063-4442-88b8-3ec829613adf req-da2b15ed-b430-465f-bd01-e419bc78d584 service nova] Acquiring lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:19:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a9ee5ba0-7063-4442-88b8-3ec829613adf req-da2b15ed-b430-465f-bd01-e419bc78d584 service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:19:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-a9ee5ba0-7063-4442-88b8-3ec829613adf req-da2b15ed-b430-465f-bd01-e419bc78d584 service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:19:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-a9ee5ba0-7063-4442-88b8-3ec829613adf req-da2b15ed-b430-465f-bd01-e419bc78d584 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] No waiting events found dispatching network-vif-unplugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:19:42 user nova-compute[75826]: WARNING nova.compute.manager [req-a9ee5ba0-7063-4442-88b8-3ec829613adf req-da2b15ed-b430-465f-bd01-e419bc78d584 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received unexpected event network-vif-unplugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc for instance with vm_state active and task_state shelving.
Nov 16 01:19:42 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:19:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:19:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:42 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Instance destroyed successfully.
Nov 16 01:19:42 user nova-compute[75826]: DEBUG nova.compute.manager [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:19:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:19:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquired lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:19:42 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:19:42 user nova-compute[75826]: DEBUG nova.network.neutron [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating instance_info_cache with network_info: [{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:19:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Releasing lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:19:43 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Instance destroyed successfully.
Nov 16 01:19:43 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lazy-loading 'resources' on Instance uuid a7dcc94c-03b0-4074-8669-88953b80e50d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-16T01:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-890730728',display_name='tempest-TestShelveInstance-server-890730728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-890730728',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi9PTpAve9X0akAiJ1yFYS8MQ+iSMEyi9FAphfu6ArF6suwIkhSt6eTp4fJ5l+C5sp8ujFVWVuN8DZ4vxzLULL589PtoVPsh+rwj3iyefiKc87zvtkftZ8ahQHEUijFgg==',key_name='tempest-TestShelveInstance-681347913',keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:17:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fb0835e39b64da1bfc6353477f59a69',ramdisk_id='',reservation_id='r-82j2k6z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1257684070',owner_user_name='tempest-TestShelveInstance-1257684070-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:17:59Z,user_data=None,user_id='5f1dcde0f72845ba8b644430536aa38b',uuid=a7dcc94c-03b0-4074-8669-88953b80e50d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Converting VIF {"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_vif [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap354aaf2c-eb, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b899780d-e1d1-4824-b719-50c98391e8ac) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:43 user nova-compute[75826]: INFO os_vif [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb')
Nov 16 01:19:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaWiAwLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:19:43 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e475e4e-0038-4bb9-80d8-f5e6351b2395]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:19:43 user nova-compute[75826]: No targets found.
Nov 16 01:19:43 user nova-compute[75826]: iSNS:
Nov 16 01:19:43 user nova-compute[75826]: No targets found.
Nov 16 01:19:43 user nova-compute[75826]: STATIC:
Nov 16 01:19:43 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532
Nov 16 01:19:43 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:19:43 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:19:43 user nova-compute[75826]: FIRMWARE:
Nov 16 01:19:43 user nova-compute[75826]: No targets found.
Nov 16 01:19:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:19:43 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:19:43 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f7d21b-a875-4baf-b9fe-e60018b6b074]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e91087-dc18-4085-b639-ead617dd5ea6]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 (non-flash)
Nov 16 01:19:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 (non-flash)
Nov 16 01:19:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcd944f2b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532'): ({'sdb'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Removing single pathed devices sdb {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e67d21-ea4a-4e84-ae9f-7cec4f577d76]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa33c5d-29e2-4b54-8607-d6e4a80d6547]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Flushing IO for device /dev/sdb {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a6db8c-deb7-4b3f-a5f7-e50aa7e48851]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3237fb7-1bfc-41f1-bd0c-39b615932079]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6013edd0-e0e0-41e8-b594-5bf1d1644403]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae6ba6d-5395-4b3c-8c78-d2a9a58e6970]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260]
Nov 16 01:19:43 user nova-compute[75826]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260] successful.
Nov 16 01:19:43 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[657bed94-3a46-430d-bc7d-d9d9b0c8aff7]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] <== disconnect_volume: return (294ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:19:43 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:19:43 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Deleting instance files /opt/stack/data/nova/instances/a7dcc94c-03b0-4074-8669-88953b80e50d_del
Nov 16 01:19:43 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Deletion of /opt/stack/data/nova/instances/a7dcc94c-03b0-4074-8669-88953b80e50d_del complete
Nov 16 01:19:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] Acquiring lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] No waiting events found dispatching network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:19:44 user nova-compute[75826]: WARNING nova.compute.manager [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received unexpected event network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc for instance with vm_state active and task_state shelving.
Nov 16 01:19:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-changed-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG nova.compute.manager [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Refreshing instance network info cache due to event network-changed-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] Acquiring lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] Acquired lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Refreshing network info cache for port 354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updated VIF entry in instance network info cache for port 354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG nova.network.neutron [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating instance_info_cache with network_info: [{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": null, "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-61dedc5a-e24b-4aa2-812a-a50c4732b0f0 req-1681cb8d-1fbc-41c5-a57e-8b82c439f96c service nova] Releasing lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:19:44 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Deleted allocations for instance a7dcc94c-03b0-4074-8669-88953b80e50d
Nov 16 01:19:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG nova.objects.instance [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lazy-loading 'numa_topology' on Instance uuid a7dcc94c-03b0-4074-8669-88953b80e50d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG nova.objects.base [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Object Instance<a7dcc94c-03b0-4074-8669-88953b80e50d> lazy-loaded attributes: resources,numa_topology {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.114s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:19:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-c74e1319-e58f-443b-9e91-eb7557916b21 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.227s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:19:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:48 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:19:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:49 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:19:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:19:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:19:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:19:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:19:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:19:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:20:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:20:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:20:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:20:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:20:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:20:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:20:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:20:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:20:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:20:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:25 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:20:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:30 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:20:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:20:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:20:30 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:20:32 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:20:32 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:20:32 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9215MB free_disk=25.243900299072266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing inventories for resource provider 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating ProviderTree inventory for provider 015246d3-5250-41ea-8943-b837ba3f5938 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Updating inventory in ProviderTree for provider 015246d3-5250-41ea-8943-b837ba3f5938 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing aggregate associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, aggregates: None {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Refreshing trait associations for resource provider 015246d3-5250-41ea-8943-b837ba3f5938, traits: COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_MMX,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE2,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_EXTEND,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE42,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_TRUSTED_CERTS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=75826) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:20:32 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.483s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:20:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:20:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:20:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:20:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:20:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:20:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:34 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:20:35 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:20:37 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:20:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:20:40 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:20:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:20:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:20:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:20:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:20:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:44 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:20:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:20:44 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:20:48 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:20:48 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75826) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 16 01:20:48 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:50 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:20:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:20:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:20:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:20:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:20:53 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:20:55 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:20:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Cleaning up deleted instances {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 16 01:20:55 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] There are 0 instances to clean {{(pid=75826) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 16 01:20:58 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:21:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:21:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:21:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:21:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:21:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:21:03 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:21:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:21:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:21:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:21:08 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:13 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:21:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:21:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:21:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:21:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:21:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:21:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:21:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:21:23 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:26 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:21:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:21:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:21:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:21:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:21:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:21:28 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:32 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:21:32 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:21:32 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:21:32 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:21:33 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:21:33 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:21:33 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9207MB free_disk=25.24332046508789GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "a7dcc94c-03b0-4074-8669-88953b80e50d" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:21:33 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:21:33 user nova-compute[75826]: INFO nova.compute.manager [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Unshelving
Nov 16 01:21:33 user nova-compute[75826]: INFO nova.virt.block_device [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Booting with volume 961da9ac-578a-4e39-ad0d-66c9b70cb532 at /dev/vda
Nov 16 01:21:34 user nova-compute[75826]: DEBUG os_brick.utils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8f959a-b0c8-4fc1-bb17-c4cc7b787a79]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:422244cf7151\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff043712-dad3-44db-9193-2f889f89f08a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[801e2bef-2c04-4c8f-81e0-af33de834e6c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61db11b-d109-4113-bebd-d3ff9380a592]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Running cmd (subprocess): nvme version {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] 'nvme version' failed. Not Retrying. {{(pid=75826) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] nvme not present on system {{(pid=75826) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 16 01:21:34 user nova-compute[75826]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 16 01:21:34 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[313801e3-7bb6-40e8-a6ae-8843916fc156]: (4, '') {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75826) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.lightos [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] LIGHTOS: no hostnqn found. {{(pid=75826) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG os_brick.utils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:422244cf7151', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:21:34 user nova-compute[75826]: DEBUG nova.virt.block_device [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating existing volume attachment record: 19beb9e8-a9b4-4151-9bc3-e6d21695990b {{(pid=75826) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 16 01:21:35 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:21:36 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:21:38 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:21:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:21:38 user nova-compute[75826]: DEBUG nova.objects.instance [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lazy-loading 'pci_requests' on Instance uuid a7dcc94c-03b0-4074-8669-88953b80e50d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:21:38 user nova-compute[75826]: DEBUG nova.objects.instance [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lazy-loading 'numa_topology' on Instance uuid a7dcc94c-03b0-4074-8669-88953b80e50d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:21:38 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75826) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 16 01:21:38 user nova-compute[75826]: INFO nova.compute.claims [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Claim successful on node user
Nov 16 01:21:38 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:21:38 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:21:38 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.233s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:21:39 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:21:39 user nova-compute[75826]: INFO nova.network.neutron [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating port 354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 16 01:21:39 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:21:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquired lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:21:39 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Building network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 16 01:21:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-bc8ac909-f196-4366-8e58-6a94193b63af req-cfdf3325-261a-4960-ac4f-c118e691848b service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-changed-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:21:39 user nova-compute[75826]: DEBUG nova.compute.manager [req-bc8ac909-f196-4366-8e58-6a94193b63af req-cfdf3325-261a-4960-ac4f-c118e691848b service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Refreshing instance network info cache due to event network-changed-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:21:39 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bc8ac909-f196-4366-8e58-6a94193b63af req-cfdf3325-261a-4960-ac4f-c118e691848b service nova] Acquiring lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.network.neutron [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating instance_info_cache with network_info: [{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Releasing lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Creating instance directory {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 16 01:21:40 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Creating image(s)
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Did not create local disks {{(pid=75826) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Ensure instance console log exists: /opt/stack/data/nova/instances/a7dcc94c-03b0-4074-8669-88953b80e50d/console.log {{(pid=75826) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Start _get_guest_xml network_info=[{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '19beb9e8-a9b4-4151-9bc3-e6d21695990b', 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaWiAwLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a7dcc94c-03b0-4074-8669-88953b80e50d', 'attached_at': '', 'detached_at': '', 'volume_id': '961da9ac-578a-4e39-ad0d-66c9b70cb532', 'serial': '961da9ac-578a-4e39-ad0d-66c9b70cb532'}, 'boot_index': 0, 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bc8ac909-f196-4366-8e58-6a94193b63af req-cfdf3325-261a-4960-ac4f-c118e691848b service nova] Acquired lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.network.neutron [req-bc8ac909-f196-4366-8e58-6a94193b63af req-cfdf3325-261a-4960-ac4f-c118e691848b service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Refreshing network info cache for port 354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:21:40 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:21:40 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] CPU controller missing on host. {{(pid=75826) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.host [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] CPU controller found on host. {{(pid=75826) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75826) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-16T00:35:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Flavor limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Image limits 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Flavor pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Image pref 0:0:0 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75826) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Got 1 possible topologies {{(pid=75826) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.hardware [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75826) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.objects.instance [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lazy-loading 'vcpu_model' on Instance uuid a7dcc94c-03b0-4074-8669-88953b80e50d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.objects.base [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Object Instance<a7dcc94c-03b0-4074-8669-88953b80e50d> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Calling os-brick to attach iSCSI Volume {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaWiAwLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:21:40 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:21:40 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:21:40 user nova-compute[75826]: INFO os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b5926c-7d48-4c50-b2a8-74049047e339]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 16 01:21:40 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --interface default --op new {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad1f248-b0c9-4c66-8c96-42cd8c2f283c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532] added\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532] added
Nov 16 01:21:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a286b8-3524-48fd-8237-20124ad17a3c]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6ff86d-54d1-4c62-8f4b-7be12d20b2ff]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaWiAwLn {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SaWiAwLn" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0879660-0dd2-499c-be98-d1a2b38a55ae]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SaWiAwLn'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e523cf97-462b-485c-8d82-a22a7782f147]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea30fed9-6eef-41f2-87d8-439c6df48288]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 16 01:21:40 user nova-compute[75826]:  {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 16 01:21:40 user nova-compute[75826]:  {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:21:40 user nova-compute[75826]: WARNING os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 16 01:21:40 user nova-compute[75826]: 
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --login {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9ead3e-9022-42ed-a42c-29a197d01303]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260]
Nov 16 01:21:40 user nova-compute[75826]: Login to [iface: default, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260] successful.
Nov 16 01:21:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[147053b4-306e-41ce-90a6-aa493d58fb53]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[9828daad-7ce7-472b-a7fe-cb916bca5768]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 (non-flash)
Nov 16 01:21:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 (non-flash)
Nov 16 01:21:40 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Connected to 172.16.0.220:3260 {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75826) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75826) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[70353ae1-a7d1-45fd-8be2-a830af91cb9a]: (4, ('- - 0', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.network.neutron [req-bc8ac909-f196-4366-8e58-6a94193b63af req-cfdf3325-261a-4960-ac4f-c118e691848b service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updated VIF entry in instance network info cache for port 354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG nova.network.neutron [req-bc8ac909-f196-4366-8e58-6a94193b63af req-cfdf3325-261a-4960-ac4f-c118e691848b service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating instance_info_cache with network_info: [{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:21:40 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bc8ac909-f196-4366-8e58-6a94193b63af req-cfdf3325-261a-4960-ac4f-c118e691848b service nova] Releasing lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75826) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaWiAwLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75826) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.307s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23935623538343032', 'path': '/dev/sdb'} {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935623538343032', 'path': '/dev/sdb'} {{(pid=75826) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T01:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-890730728',display_name='tempest-TestShelveInstance-server-890730728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-890730728',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-681347913',keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:17:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2fb0835e39b64da1bfc6353477f59a69',ramdisk_id='',reservation_id='r-82j2k6z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1257684070',owner_user_name='tempest-TestShelveInstance-1257684070-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:21:34Z,user_data=None,user_id='5f1dcde0f72845ba8b644430536aa38b',uuid=a7dcc94c-03b0-4074-8669-88953b80e50d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75826) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Converting VIF {"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG nova.objects.instance [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lazy-loading 'pci_devices' on Instance uuid a7dcc94c-03b0-4074-8669-88953b80e50d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG nova.objects.base [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Object Instance<a7dcc94c-03b0-4074-8669-88953b80e50d> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75826) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] End _get_guest_xml xml=<domain type="kvm">
Nov 16 01:21:41 user nova-compute[75826]:   <uuid>a7dcc94c-03b0-4074-8669-88953b80e50d</uuid>
Nov 16 01:21:41 user nova-compute[75826]:   <name>instance-00000034</name>
Nov 16 01:21:41 user nova-compute[75826]:   <memory>524288</memory>
Nov 16 01:21:41 user nova-compute[75826]:   <vcpu>1</vcpu>
Nov 16 01:21:41 user nova-compute[75826]:   <metadata>
Nov 16 01:21:41 user nova-compute[75826]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 16 01:21:41 user nova-compute[75826]:       <nova:package version="0.0.0"/>
Nov 16 01:21:41 user nova-compute[75826]:       <nova:name>tempest-TestShelveInstance-server-890730728</nova:name>
Nov 16 01:21:41 user nova-compute[75826]:       <nova:creationTime>2023-11-16 01:21:40</nova:creationTime>
Nov 16 01:21:41 user nova-compute[75826]:       <nova:flavor name="m1.tiny">
Nov 16 01:21:41 user nova-compute[75826]:         <nova:memory>512</nova:memory>
Nov 16 01:21:41 user nova-compute[75826]:         <nova:disk>1</nova:disk>
Nov 16 01:21:41 user nova-compute[75826]:         <nova:swap>0</nova:swap>
Nov 16 01:21:41 user nova-compute[75826]:         <nova:ephemeral>0</nova:ephemeral>
Nov 16 01:21:41 user nova-compute[75826]:         <nova:vcpus>1</nova:vcpus>
Nov 16 01:21:41 user nova-compute[75826]:       </nova:flavor>
Nov 16 01:21:41 user nova-compute[75826]:       <nova:owner>
Nov 16 01:21:41 user nova-compute[75826]:         <nova:user uuid="5f1dcde0f72845ba8b644430536aa38b">tempest-TestShelveInstance-1257684070-project-member</nova:user>
Nov 16 01:21:41 user nova-compute[75826]:         <nova:project uuid="2fb0835e39b64da1bfc6353477f59a69">tempest-TestShelveInstance-1257684070</nova:project>
Nov 16 01:21:41 user nova-compute[75826]:       </nova:owner>
Nov 16 01:21:41 user nova-compute[75826]:       <nova:ports>
Nov 16 01:21:41 user nova-compute[75826]:         <nova:port uuid="354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc">
Nov 16 01:21:41 user nova-compute[75826]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 16 01:21:41 user nova-compute[75826]:         </nova:port>
Nov 16 01:21:41 user nova-compute[75826]:       </nova:ports>
Nov 16 01:21:41 user nova-compute[75826]:     </nova:instance>
Nov 16 01:21:41 user nova-compute[75826]:   </metadata>
Nov 16 01:21:41 user nova-compute[75826]:   <sysinfo type="smbios">
Nov 16 01:21:41 user nova-compute[75826]:     <system>
Nov 16 01:21:41 user nova-compute[75826]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 16 01:21:41 user nova-compute[75826]:       <entry name="product">OpenStack Nova</entry>
Nov 16 01:21:41 user nova-compute[75826]:       <entry name="version">0.0.0</entry>
Nov 16 01:21:41 user nova-compute[75826]:       <entry name="serial">a7dcc94c-03b0-4074-8669-88953b80e50d</entry>
Nov 16 01:21:41 user nova-compute[75826]:       <entry name="uuid">a7dcc94c-03b0-4074-8669-88953b80e50d</entry>
Nov 16 01:21:41 user nova-compute[75826]:       <entry name="family">Virtual Machine</entry>
Nov 16 01:21:41 user nova-compute[75826]:     </system>
Nov 16 01:21:41 user nova-compute[75826]:   </sysinfo>
Nov 16 01:21:41 user nova-compute[75826]:   <os>
Nov 16 01:21:41 user nova-compute[75826]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 16 01:21:41 user nova-compute[75826]:     <boot dev="hd"/>
Nov 16 01:21:41 user nova-compute[75826]:     <smbios mode="sysinfo"/>
Nov 16 01:21:41 user nova-compute[75826]:   </os>
Nov 16 01:21:41 user nova-compute[75826]:   <features>
Nov 16 01:21:41 user nova-compute[75826]:     <acpi/>
Nov 16 01:21:41 user nova-compute[75826]:     <apic/>
Nov 16 01:21:41 user nova-compute[75826]:     <vmcoreinfo/>
Nov 16 01:21:41 user nova-compute[75826]:   </features>
Nov 16 01:21:41 user nova-compute[75826]:   <clock offset="utc">
Nov 16 01:21:41 user nova-compute[75826]:     <timer name="pit" tickpolicy="delay"/>
Nov 16 01:21:41 user nova-compute[75826]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 16 01:21:41 user nova-compute[75826]:     <timer name="hpet" present="no"/>
Nov 16 01:21:41 user nova-compute[75826]:   </clock>
Nov 16 01:21:41 user nova-compute[75826]:   <cpu mode="custom" match="exact">
Nov 16 01:21:41 user nova-compute[75826]:     <model>Nehalem</model>
Nov 16 01:21:41 user nova-compute[75826]:     <topology sockets="1" cores="1" threads="1"/>
Nov 16 01:21:41 user nova-compute[75826]:   </cpu>
Nov 16 01:21:41 user nova-compute[75826]:   <devices>
Nov 16 01:21:41 user nova-compute[75826]:     <disk type="block" device="disk">
Nov 16 01:21:41 user nova-compute[75826]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 16 01:21:41 user nova-compute[75826]:       <source dev="/dev/sdb"/>
Nov 16 01:21:41 user nova-compute[75826]:       <target dev="vda" bus="virtio"/>
Nov 16 01:21:41 user nova-compute[75826]:       <serial>961da9ac-578a-4e39-ad0d-66c9b70cb532</serial>
Nov 16 01:21:41 user nova-compute[75826]:     </disk>
Nov 16 01:21:41 user nova-compute[75826]:     <interface type="ethernet">
Nov 16 01:21:41 user nova-compute[75826]:       <mac address="fa:16:3e:4c:c7:fc"/>
Nov 16 01:21:41 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:21:41 user nova-compute[75826]:       <mtu size="1442"/>
Nov 16 01:21:41 user nova-compute[75826]:       <target dev="tap354aaf2c-eb"/>
Nov 16 01:21:41 user nova-compute[75826]:     </interface>
Nov 16 01:21:41 user nova-compute[75826]:     <serial type="pty">
Nov 16 01:21:41 user nova-compute[75826]:       <log file="/opt/stack/data/nova/instances/a7dcc94c-03b0-4074-8669-88953b80e50d/console.log" append="off"/>
Nov 16 01:21:41 user nova-compute[75826]:     </serial>
Nov 16 01:21:41 user nova-compute[75826]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 16 01:21:41 user nova-compute[75826]:     <video>
Nov 16 01:21:41 user nova-compute[75826]:       <model type="virtio"/>
Nov 16 01:21:41 user nova-compute[75826]:     </video>
Nov 16 01:21:41 user nova-compute[75826]:     <rng model="virtio">
Nov 16 01:21:41 user nova-compute[75826]:       <backend model="random">/dev/urandom</backend>
Nov 16 01:21:41 user nova-compute[75826]:     </rng>
Nov 16 01:21:41 user nova-compute[75826]:     <controller type="usb" index="0" model="none"/>
Nov 16 01:21:41 user nova-compute[75826]:     <memballoon model="virtio">
Nov 16 01:21:41 user nova-compute[75826]:       <stats period="10"/>
Nov 16 01:21:41 user nova-compute[75826]:     </memballoon>
Nov 16 01:21:41 user nova-compute[75826]:   </devices>
Nov 16 01:21:41 user nova-compute[75826]: </domain>
Nov 16 01:21:41 user nova-compute[75826]:  {{(pid=75826) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T01:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-890730728',display_name='tempest-TestShelveInstance-server-890730728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-890730728',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-681347913',keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:17:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='2fb0835e39b64da1bfc6353477f59a69',ramdisk_id='',reservation_id='r-82j2k6z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1257684070',owner_user_name='tempest-TestShelveInstance-1257684070-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:21:34Z,user_data=None,user_id='5f1dcde0f72845ba8b644430536aa38b',uuid=a7dcc94c-03b0-4074-8669-88953b80e50d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Converting VIF {"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG os_vif [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb') {{(pid=75826) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1aa74301-936b-57ae-8c39-77a9ab2423d7', '_type': 'linux-noop'}}, row=False) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap354aaf2c-eb, may_exist=True, interface_attrs={}) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap354aaf2c-eb, col_values=(('qos', UUID('2748e16c-0587-4e08-93bc-f1fc41ad44ac')),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap354aaf2c-eb, col_values=(('external_ids', {'iface-id': '354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:c7:fc', 'vm-uuid': 'a7dcc94c-03b0-4074-8669-88953b80e50d'}),), if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:41 user nova-compute[75826]: INFO os_vif [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb')
Nov 16 01:21:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] No BDM found with device name vda, not building metadata. {{(pid=75826) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 16 01:21:41 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] No VIF found with MAC fa:16:3e:4c:c7:fc, not building metadata {{(pid=75826) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 16 01:21:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:42 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-66d52043-6059-4c2a-9863-04b70484c698 req-227947b5-f27c-4745-8b0f-c1ad9f165038 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:21:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66d52043-6059-4c2a-9863-04b70484c698 req-227947b5-f27c-4745-8b0f-c1ad9f165038 service nova] Acquiring lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:21:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66d52043-6059-4c2a-9863-04b70484c698 req-227947b5-f27c-4745-8b0f-c1ad9f165038 service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:21:42 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-66d52043-6059-4c2a-9863-04b70484c698 req-227947b5-f27c-4745-8b0f-c1ad9f165038 service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:21:42 user nova-compute[75826]: DEBUG nova.compute.manager [req-66d52043-6059-4c2a-9863-04b70484c698 req-227947b5-f27c-4745-8b0f-c1ad9f165038 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] No waiting events found dispatching network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:21:42 user nova-compute[75826]: WARNING nova.compute.manager [req-66d52043-6059-4c2a-9863-04b70484c698 req-227947b5-f27c-4745-8b0f-c1ad9f165038 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received unexpected event network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc for instance with vm_state shelved_offloaded and task_state spawning.
Nov 16 01:21:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:43 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Instance event wait completed in 0 seconds for  {{(pid=75826) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 16 01:21:44 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Guest created on hypervisor {{(pid=75826) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 16 01:21:44 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Instance spawned successfully.
Nov 16 01:21:44 user nova-compute[75826]: DEBUG nova.compute.manager [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Checking state {{(pid=75826) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 16 01:21:44 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-8be14463-322e-4368-a9d2-ec2f2ad706ce tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.159s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:21:45 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:21:45 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:21:45 user nova-compute[75826]: DEBUG nova.compute.manager [req-c237120e-8cef-44b1-8945-13e8bff90ddd req-5e73ffdf-a23f-42fc-99ab-e264af938cc3 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:21:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c237120e-8cef-44b1-8945-13e8bff90ddd req-5e73ffdf-a23f-42fc-99ab-e264af938cc3 service nova] Acquiring lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:21:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c237120e-8cef-44b1-8945-13e8bff90ddd req-5e73ffdf-a23f-42fc-99ab-e264af938cc3 service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:21:45 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-c237120e-8cef-44b1-8945-13e8bff90ddd req-5e73ffdf-a23f-42fc-99ab-e264af938cc3 service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:21:45 user nova-compute[75826]: DEBUG nova.compute.manager [req-c237120e-8cef-44b1-8945-13e8bff90ddd req-5e73ffdf-a23f-42fc-99ab-e264af938cc3 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] No waiting events found dispatching network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:21:45 user nova-compute[75826]: WARNING nova.compute.manager [req-c237120e-8cef-44b1-8945-13e8bff90ddd req-5e73ffdf-a23f-42fc-99ab-e264af938cc3 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received unexpected event network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc for instance with vm_state active and task_state None.
Nov 16 01:21:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:50 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:21:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:51 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:21:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:21:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:21:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:21:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:21:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:21:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:22:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:22:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:22:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:22:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:22:26 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:27 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:22:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:22:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:22:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:22:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:22:31 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquired lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Forcefully refreshing network info cache for instance {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG nova.objects.instance [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lazy-loading 'info_cache' on Instance uuid a7dcc94c-03b0-4074-8669-88953b80e50d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG nova.network.neutron [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating instance_info_cache with network_info: [{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Releasing lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updated the network info_cache for instance {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75826) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 16 01:22:34 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:22:34 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:22:34 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9058MB free_disk=25.23398208618164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:22:34 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:22:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Instance a7dcc94c-03b0-4074-8669-88953b80e50d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75826) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 16 01:22:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:22:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:22:35 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:22:35 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:22:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:22:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.177s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:22:36 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:22:37 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:22:38 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:22:40 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:22:41 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:22:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:22:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:22:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:22:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:22:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:22:41 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:22:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:22:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:22:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:22:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:22:46 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:47 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:22:47 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:22:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:22:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:22:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:22:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:22:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:22:51 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:22:53 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:22:56 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:23:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:23:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:23:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:23:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:23:01 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:23:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:23:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:23:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:23:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:23:06 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:11 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:23:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:23:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:23:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:23:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:23:16 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:23:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-9aa49f9c-8f94-45e6-b3a4-89742fe088cb req-ff165259-24dc-44c0-b6a8-4689c1dea704 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-changed-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:23:24 user nova-compute[75826]: DEBUG nova.compute.manager [req-9aa49f9c-8f94-45e6-b3a4-89742fe088cb req-ff165259-24dc-44c0-b6a8-4689c1dea704 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Refreshing instance network info cache due to event network-changed-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc. {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 16 01:23:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9aa49f9c-8f94-45e6-b3a4-89742fe088cb req-ff165259-24dc-44c0-b6a8-4689c1dea704 service nova] Acquiring lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 16 01:23:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9aa49f9c-8f94-45e6-b3a4-89742fe088cb req-ff165259-24dc-44c0-b6a8-4689c1dea704 service nova] Acquired lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 16 01:23:24 user nova-compute[75826]: DEBUG nova.network.neutron [req-9aa49f9c-8f94-45e6-b3a4-89742fe088cb req-ff165259-24dc-44c0-b6a8-4689c1dea704 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Refreshing network info cache for port 354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 16 01:23:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "a7dcc94c-03b0-4074-8669-88953b80e50d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:23:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:23:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:23:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:23:24 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:23:24 user nova-compute[75826]: INFO nova.compute.manager [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Terminating instance
Nov 16 01:23:24 user nova-compute[75826]: DEBUG nova.compute.manager [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Start destroying the instance on the hypervisor. {{(pid=75826) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 16 01:23:24 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-97ae4dec-def9-499c-bf61-1b3d04265f0f req-89e02802-1931-414d-8f4e-9dd13ebd2b7b service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-vif-unplugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-97ae4dec-def9-499c-bf61-1b3d04265f0f req-89e02802-1931-414d-8f4e-9dd13ebd2b7b service nova] Acquiring lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-97ae4dec-def9-499c-bf61-1b3d04265f0f req-89e02802-1931-414d-8f4e-9dd13ebd2b7b service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-97ae4dec-def9-499c-bf61-1b3d04265f0f req-89e02802-1931-414d-8f4e-9dd13ebd2b7b service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-97ae4dec-def9-499c-bf61-1b3d04265f0f req-89e02802-1931-414d-8f4e-9dd13ebd2b7b service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] No waiting events found dispatching network-vif-unplugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG nova.compute.manager [req-97ae4dec-def9-499c-bf61-1b3d04265f0f req-89e02802-1931-414d-8f4e-9dd13ebd2b7b service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-vif-unplugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc for instance with task_state deleting. {{(pid=75826) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG nova.network.neutron [req-9aa49f9c-8f94-45e6-b3a4-89742fe088cb req-ff165259-24dc-44c0-b6a8-4689c1dea704 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updated VIF entry in instance network info cache for port 354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc. {{(pid=75826) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG nova.network.neutron [req-9aa49f9c-8f94-45e6-b3a4-89742fe088cb req-ff165259-24dc-44c0-b6a8-4689c1dea704 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating instance_info_cache with network_info: [{"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-9aa49f9c-8f94-45e6-b3a4-89742fe088cb req-ff165259-24dc-44c0-b6a8-4689c1dea704 service nova] Releasing lock "refresh_cache-a7dcc94c-03b0-4074-8669-88953b80e50d" {{(pid=75826) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 16 01:23:25 user nova-compute[75826]: INFO nova.virt.libvirt.driver [-] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Instance destroyed successfully.
Nov 16 01:23:25 user nova-compute[75826]: DEBUG nova.objects.instance [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lazy-loading 'resources' on Instance uuid a7dcc94c-03b0-4074-8669-88953b80e50d {{(pid=75826) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.vif [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-16T01:17:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-890730728',display_name='tempest-TestShelveInstance-server-890730728',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-890730728',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEi9PTpAve9X0akAiJ1yFYS8MQ+iSMEyi9FAphfu6ArF6suwIkhSt6eTp4fJ5l+C5sp8ujFVWVuN8DZ4vxzLULL589PtoVPsh+rwj3iyefiKc87zvtkftZ8ahQHEUijFgg==',key_name='tempest-TestShelveInstance-681347913',keypairs=<?>,launch_index=0,launched_at=2023-11-16T01:21:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2fb0835e39b64da1bfc6353477f59a69',ramdisk_id='',reservation_id='r-82j2k6z0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1257684070',owner_user_name='tempest-TestShelveInstance-1257684070-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-16T01:21:45Z,user_data=None,user_id='5f1dcde0f72845ba8b644430536aa38b',uuid=a7dcc94c-03b0-4074-8669-88953b80e50d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Converting VIF {"id": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "address": "fa:16:3e:4c:c7:fc", "network": {"id": "633603d9-f660-4a0d-9bee-4b4a42e006cb", "bridge": "br-int", "label": "tempest-TestShelveInstance-703644954-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2fb0835e39b64da1bfc6353477f59a69", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap354aaf2c-eb", "ovs_interfaceid": "354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG nova.network.os_vif_util [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb') {{(pid=75826) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_vif [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb') {{(pid=75826) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap354aaf2c-eb, bridge=br-int, if_exists=True) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2748e16c-0587-4e08-93bc-f1fc41ad44ac) {{(pid=75826) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:23:25 user nova-compute[75826]: INFO os_vif [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:c7:fc,bridge_name='br-int',has_traffic_filtering=True,id=354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc,network=Network(633603d9-f660-4a0d-9bee-4b4a42e006cb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354aaf2c-eb')
Nov 16 01:23:25 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] calling os-brick to detach iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fcdb4310880>, {'target_iqn': 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SaWiAwLn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 16 01:23:25 user nova-compute[75826]: WARNING os_brick.initiator.connectors.base [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdaa6be-e82c-409e-a6dd-97389f4b919f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 16 01:23:25 user nova-compute[75826]: No targets found.
Nov 16 01:23:25 user nova-compute[75826]: iSNS:
Nov 16 01:23:25 user nova-compute[75826]: No targets found.
Nov 16 01:23:25 user nova-compute[75826]: STATIC:
Nov 16 01:23:25 user nova-compute[75826]: Target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532
Nov 16 01:23:25 user nova-compute[75826]:         Portal: 172.16.0.220:3260,-1
Nov 16 01:23:25 user nova-compute[75826]:                 Iface Name: default
Nov 16 01:23:25 user nova-compute[75826]: FIRMWARE:
Nov 16 01:23:25 user nova-compute[75826]: No targets found.
Nov 16 01:23:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 16 01:23:25 user nova-compute[75826]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 16 01:23:25 user nova-compute[75826]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75826) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532', 0)] {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3d995f-ccc6-433b-949a-6c76d0b2ea4d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec62747-8a3f-4f78-93f2-ba8569a57226]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 (non-flash)\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 (non-flash)
Nov 16 01:23:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 (non-flash)
Nov 16 01:23:25 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fcdb4498700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532'): ({'sdb'}, set())}) {{(pid=75826) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Removing single pathed devices sdb {{(pid=75826) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5511ac-baf3-47ba-8187-ac45ce3be4ad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58b0915-2bfd-4374-8d4b-5e2c2ce7abce]: (4, ('ok\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Flushing IO for device /dev/sdb {{(pid=75826) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8cddeaa-2636-4cc2-95cc-53d934449650]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75826) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d41a58-63f4-4a2d-97b0-536e683f99b0]: (4, ('1', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.linuxscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] SCSI volumes sdb have been removed. {{(pid=75826) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b545c179', '/dev/disk/by-id/scsi-1SCST_BIOb545c179-95b5840283e6218c', '/dev/disk/by-id/scsi-23935623538343032') {{(pid=85991) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c383739-62c4-4f7f-8784-f98cd91811e7]: (4, None) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532')] {{(pid=75826) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8e7adc-1e82-4de5-9696-25480ede0312]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:23:25 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --logout {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:23:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:23:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b0ff82-ec24-4c6a-bbb5-6a79d4386d73]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:23:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260]
Nov 16 01:23:26 user nova-compute[75826]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532, portal: 172.16.0.220,3260] successful.
Nov 16 01:23:26 user nova-compute[75826]:  stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:23:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op delete {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 16 01:23:26 user nova-compute[75826]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:961da9ac-578a-4e39-ad0d-66c9b70cb532 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85991) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 16 01:23:26 user nova-compute[75826]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9e7601-fb58-42bb-8227-aa72d5a7dc94]: (4, ('', '')) {{(pid=85991) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 16 01:23:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75826) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 16 01:23:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.base [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 16 01:23:26 user nova-compute[75826]: DEBUG os_brick.initiator.connectors.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] <== disconnect_volume: return (302ms) None {{(pid=75826) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 16 01:23:26 user nova-compute[75826]: DEBUG nova.virt.libvirt.volume.iscsi [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Disconnected iSCSI Volume {{(pid=75826) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 16 01:23:26 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Deleting instance files /opt/stack/data/nova/instances/a7dcc94c-03b0-4074-8669-88953b80e50d_del
Nov 16 01:23:26 user nova-compute[75826]: INFO nova.virt.libvirt.driver [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Deletion of /opt/stack/data/nova/instances/a7dcc94c-03b0-4074-8669-88953b80e50d_del complete
Nov 16 01:23:26 user nova-compute[75826]: INFO nova.compute.manager [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 16 01:23:26 user nova-compute[75826]: DEBUG oslo.service.loopingcall [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75826) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 16 01:23:26 user nova-compute[75826]: DEBUG nova.compute.manager [-] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Deallocating network for instance {{(pid=75826) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 16 01:23:26 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] deallocate_for_instance() {{(pid=75826) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 16 01:23:26 user nova-compute[75826]: DEBUG nova.network.neutron [-] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Updating instance_info_cache with network_info: [] {{(pid=75826) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 16 01:23:26 user nova-compute[75826]: INFO nova.compute.manager [-] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Took 0.40 seconds to deallocate network for instance.
Nov 16 01:23:27 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:23:27 user nova-compute[75826]: INFO nova.compute.manager [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Took 0.78 seconds to detach 1 volumes for instance.
Nov 16 01:23:27 user nova-compute[75826]: DEBUG nova.compute.manager [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Deleting volume: 961da9ac-578a-4e39-ad0d-66c9b70cb532 {{(pid=75826) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 16 01:23:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:23:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:23:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-bec79691-8c2d-4563-b641-99c8b2ab39c4 req-c0f1d5bb-b463-415a-a008-15c63d3139f0 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:23:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bec79691-8c2d-4563-b641-99c8b2ab39c4 req-c0f1d5bb-b463-415a-a008-15c63d3139f0 service nova] Acquiring lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:23:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bec79691-8c2d-4563-b641-99c8b2ab39c4 req-c0f1d5bb-b463-415a-a008-15c63d3139f0 service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:23:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [req-bec79691-8c2d-4563-b641-99c8b2ab39c4 req-c0f1d5bb-b463-415a-a008-15c63d3139f0 service nova] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:23:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-bec79691-8c2d-4563-b641-99c8b2ab39c4 req-c0f1d5bb-b463-415a-a008-15c63d3139f0 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] No waiting events found dispatching network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 16 01:23:27 user nova-compute[75826]: WARNING nova.compute.manager [req-bec79691-8c2d-4563-b641-99c8b2ab39c4 req-c0f1d5bb-b463-415a-a008-15c63d3139f0 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received unexpected event network-vif-plugged-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc for instance with vm_state deleted and task_state None.
Nov 16 01:23:27 user nova-compute[75826]: DEBUG nova.compute.manager [req-bec79691-8c2d-4563-b641-99c8b2ab39c4 req-c0f1d5bb-b463-415a-a008-15c63d3139f0 service nova] [instance: a7dcc94c-03b0-4074-8669-88953b80e50d] Received event network-vif-deleted-354aaf2c-eba3-44d2-9b6b-afb0b3c0b7dc {{(pid=75826) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 16 01:23:27 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:23:27 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:23:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:23:27 user nova-compute[75826]: INFO nova.scheduler.client.report [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Deleted allocations for instance a7dcc94c-03b0-4074-8669-88953b80e50d
Nov 16 01:23:27 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-515404a2-9bf9-4667-84ac-a2c2d3db3184 tempest-TestShelveInstance-1257684070 tempest-TestShelveInstance-1257684070-project-member] Lock "a7dcc94c-03b0-4074-8669-88953b80e50d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.752s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:23:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:23:35 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:23:35 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:23:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9194MB free_disk=25.233177185058594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.161s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:23:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:23:38 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:23:39 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:23:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:23:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:23:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:23:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:23:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:42 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:23:42 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:23:45 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:23:48 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:23:48 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75826) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 16 01:23:50 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:23:52 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:23:55 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:23:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:23:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:23:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75826) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 16 01:23:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:23:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75826) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 16 01:23:55 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:24:00 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:24:05 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:24:10 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:24:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:24:15 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:24:18 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:24:20 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:24:21 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:24:25 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:24:29 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:24:30 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Starting heal instance info cache {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Rebuilding the list of instances to heal {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG nova.compute.manager [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Didn't find any instances for network info cache update. {{(pid=75826) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Auditing locally available compute resources for user (node: user) {{(pid=75826) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 16 01:24:35 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:24:35 user nova-compute[75826]: WARNING nova.virt.libvirt.driver [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 16 01:24:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Hypervisor/Node resource view: name=user free_ram=9342MB free_disk=25.23198699951172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75826) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75826) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG nova.compute.provider_tree [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed in ProviderTree for provider: 015246d3-5250-41ea-8943-b837ba3f5938 {{(pid=75826) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG nova.scheduler.client.report [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Inventory has not changed for provider 015246d3-5250-41ea-8943-b837ba3f5938 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75826) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG nova.compute.resource_tracker [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Compute_service record updated for user:user {{(pid=75826) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG oslo_concurrency.lockutils [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.106s {{(pid=75826) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 16 01:24:35 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 16 01:24:38 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:24:40 user nova-compute[75826]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 29 {{(pid=75826) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 16 01:24:41 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:24:43 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 16 01:24:43 user nova-compute[75826]: DEBUG oslo_service.periodic_task [None req-74d4b3d6-b020-4d06-81f0-71d061a599a1 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75826) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}